Help for creating a useful bugreport

Help for creating a useful bugreport

[Jakob Breier]

Hi,

my btrfs partition got corrupted. With some trouble I got most of the 
valuable data out of it using `btrfs restore -i` (it crashed a few 
times, but on the fourth or fifth run it reached the stuff I wanted to 
recover). As far as I can tell, the file system broke during normal 
operations without any hardware failures. Before I switch back to ext4, 
I'd like to file a bug report so my troubles were not completely in 
vain. Unfortunately I don't have much to work with. Can you help me with 
extracting enough information to create a useful bugreport?

Regards,
Jakob

$ cat /etc/fedora-release
Fedora release 20 (Heisenbug)

$ uname -a
Linux localhost.localdomain 3.16.2-200.fc20.x86_64 #1 SMP Mon Sep 8 
11:54:45 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux

$ sudo btrfs fi show /dev/dm-1
Label: 'EncJakobExtern'  uuid: 8ccbd085-564d-4022-bfc9-18fd429d0a8d
         Total devices 1 FS bytes used 731.07GiB
         devid    1 size 931.60GiB used 769.04GiB path 
/dev/mapper/luks-a266c492-2360-404d-9ad7-00edc2f0c09d

Btrfs v3.16

$ sudo mount /dev/dm-1 /mnt/diverse/
mount: wrong fs type, bad option, bad superblock on 
/dev/mapper/luks-a266c492-2360-404d-9ad7-00edc2f0c09d,
        missing codepage or helper program, or other error

        In some cases useful info is found in syslog - try
        dmesg | tail or so.

$ sudo mount /dev/dm-1 /mnt/diverse/ -o recovery
mount: wrong fs type, bad option, bad superblock on 
/dev/mapper/luks-a266c492-2360-404d-9ad7-00edc2f0c09d,
        missing codepage or helper program, or other error

        In some cases useful info is found in syslog - try
        dmesg | tail or so.


*Syslog:*
Sep 19 10:11:11 localhost.localdomain kernel: BTRFS: device label 
EncJakobExtern devid 1 transid 4923 /dev/dm-1
Sep 19 10:11:11 localhost.localdomain udisksd[1971]: Unlocked LUKS 
device /dev/sdb1 as /dev/dm-1

Sep 19 10:16:13 localhost.localdomain sudo[5080]: jakob : TTY=pts/6 ; 
PWD=/home/jakob ; USER=root ; COMMAND=/bin/mount /dev/dm-1 /mnt/diverse/
Sep 19 10:16:17 localhost.localdomain kernel: BTRFS info (device dm-1): 
disk space caching is enabled
Sep 19 10:16:18 localhost.localdomain kernel: parent transid verify 
failed on 46678016 wanted 4923 found 3306
Sep 19 10:16:18 localhost.localdomain kernel: parent transid verify 
failed on 46678016 wanted 4923 found 3306
Sep 19 10:16:18 localhost.localdomain kernel: BTRFS: Failed to read 
block groups: -5
Sep 19 10:16:18 localhost.localdomain kernel: BTRFS: open_ctree failed

Sep 19 10:16:45 localhost.localdomain sudo[5456]: jakob : TTY=pts/6 ; 
PWD=/home/jakob ; USER=root ; COMMAND=/bin/mount /dev/dm-1 /mnt/diverse/ 
-o recovery
Sep 19 10:16:45 localhost.localdomain kernel: BTRFS info (device dm-1): 
enabling auto recovery
Sep 19 10:16:45 localhost.localdomain kernel: BTRFS info (device dm-1): 
disk space caching is enabled
Sep 19 10:16:46 localhost.localdomain kernel: parent transid verify 
failed on 46678016 wanted 4923 found 3306
Sep 19 10:16:46 localhost.localdomain kernel: parent transid verify 
failed on 46678016 wanted 4923 found 3306
Sep 19 10:16:46 localhost.localdomain kernel: BTRFS: Failed to read 
block groups: -5
Sep 19 10:16:46 localhost.localdomain kernel: BTRFS: open_ctree failed


*fstab entry with which it was usually mounted:*
/dev/mapper/LuksOpenendEncJakobExtern /mnt/EncJakobExtern btrfs 
compress=lzo,nofail 0 0

Re: Help for creating a useful bugreport

[Chris Murphy]

On Sep 19, 2014, at 2:58 AM, Jakob Breier <Jakob.Breier@rwth-aachen.de> wrote:
> Unfortunately I don't have much to work with. Can you help me with extracting enough information to create a useful bugreport?

What storage device(s)?

Include results from
# btrfs check

And also a note whether you get different results with -s1, -s2, -s3 (how many backups superblocks you have depends on file system size so some of those might not work).

Since it won't mount you can't get fi df, but if you can provide that info so we know if, e.g. the metadata is single (by default on SSD) or DUP.

Was it created with btrfs-progs 3.16, and has it only been written to with kernel 3.16 or other kernels also?

If you can use btrfs-image per the wiki, and keep the image around, it might come in handy for a Btrfs developer.


> 
> Sep 19 10:16:18 localhost.localdomain kernel: parent transid verify failed on 46678016 wanted 4923 found 3306
> Sep 19 10:16:18 localhost.localdomain kernel: parent transid verify failed on 46678016 wanted 4923 found 3306

These messages come up often on the list. The notes written in disk-io.c say this:
 * we can't consider a given block up to date unless the transid of the
 * block matches the transid in the parent node's pointer.  This is how we
 * detect blocks that either didn't get written at all or got written
 * in the wrong place.

I don't know whether this definitely means hardware related problems of some sort, but it sounds suspiciously like that because blocks should get written in the correct place. Right? But they didn't.


> Sep 19 10:16:18 localhost.localdomain kernel: BTRFS: Failed to read block groups: -5

This came up in a recent thread "Problem with a filesystem". I'm not sure what it means.

Once you've taken the btrfs-image, and you're about ready to toss the file system it's worth trying these commands.

btrfs rescue super-recover -v
## if it fixes anything, don't continue, try to mount the fs
btrfs check --repair
## I'd try mounting even if it doesn't say it's repaired anything
btrfs check --repair --init-extent-tree
## Again try to mount the fs

And report kernel and user space messages.


Chris Murphy

Re: Help for creating a useful bugreport

[Jakob Breier]

[-- Attachment #1: Type: text/plain, Size: 11492 bytes --]

Hi,

Chris Murphy wrote:
> On Sep 19, 2014, at 2:58 AM, Jakob Breier<jakob.bre...@rwth-aachen.de>  wrote:
> > Unfortunately I don't have much to work with. Can you help me with extracting
> > enough information to create a useful bugreport?
> What storage device(s)?

The device (/dev/dm-1) is a LUKS device. It is about a gigabyte in size:

"""
$ sudo cryptsetup status /dev/dm-1
/dev/dm-1 is active.
   type:    LUKS1
   cipher:  aes-xts-plain64
   keysize: 256 bits
   device:  /dev/sdb1
   offset:  4096 sectors
   size:    1953711741 sectors
   mode:    read/write
$ sudo blockdev --getsize64 /dev/dm-1
1000300411392
$ sudo blockdev --getsize /dev/dm-1
1953711741
"""

Syslog:
"""
kernel: BTRFS: device label EncJakobExtern devid 1 transid 4923 /dev/dm-1
udisksd[3948]: Unlocked LUKS device /dev/sdb1 as /dev/dm-1
"""

The underlying hdd is an external USB device:

"""
kernel: scsi 6:0:0:0: Direct-Access     Intenso  External USB 3.0 0206 
PQ: 0 ANSI: 6
kernel: sd 6:0:0:0: Attached scsi generic sg2 type 0
kernel: sd 6:0:0:0: [sdb] 2930276352 512-byte logical blocks: (1.50 
TB/1.36 TiB)
kernel: sd 6:0:0:0: [sdb] Write Protect is off
kernel: sd 6:0:0:0: [sdb] Mode Sense: 27 00 00 00
kernel: sd 6:0:0:0: [sdb] No Caching mode page found
kernel: sd 6:0:0:0: [sdb] Assuming drive cache: write through
"""

> Include results from
> # btrfs check

Output is attached:
$ sudo btrfs check /dev/dm-1 > btrfsCheckOutput 2>&1

> And also a note whether you get different results with -s1, -s2, -s3 (how many
> backups superblocks you have depends on file system size so some of those might
> not work).

The result is identical for no parameter, -s1 and -s2, except for the 
additional "using SB copy 1, bytenr 67108864", resp. "using SB copy 2, 
bytenr 274877906944". -s3 yields "ERROR: super mirror should be less 
than: 3".

> Since it won't mount you can't get fi df, but if you can provide that info so
> we know if, e.g. the metadata is single (by default on SSD) or DUP.

I don't recall what it said (if I've run it on this partition before), 
unfortunately. I believe I have created the partition with the standard 
settings, though.

> Was it created with btrfs-progs 3.16, and has it only been written to with
> kernel 3.16 or other kernels also?

Looking through my yum history I would guess it was either created with
   btrfs-progs-0.20.rc1.20131114git9f0c53f-1.fc20.x86_64
or with
   btrfs-progs-3.12-1.fc20.x86_64
but I'm not sure. I think I've created in May or June this year. 
Similarly, the first kernel to access the fs is probably either of these:
   kernel-3.14.3-200.fc20.x86_64
   kernel-3.14.4-200.fc20.x86_64
   kernel-3.14.5-200.fc20.x86_64
   kernel-3.14.6-200.fc20.x86_64
The kernel on which the mount error first occurred and which probably 
caused the error is this one:
   kernel-3.15.7-200.fc20.x86_64

> If you can use btrfs-image per the wiki, and keep the image around, it might
> come in handy for a Btrfs developer.

I got an error running btrfs-image:

"""
$ sudo btrfs-image -c 9 -s /dev/dm-1 
/run/media/[...]/btrfsImageWithoutData.bit
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46661632 wanted 4923 found 3306
parent transid verify failed on 46661632 wanted 4923 found 3306
parent transid verify failed on 46661632 wanted 4923 found 3306
parent transid verify failed on 46661632 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
Error going to next leaf -5
create failed (Success)
"""

Nothing interesting in the syslog and no output file was written. Adding 
"-w" seemed to fix it and I got an 838MB output file:

"""
$ sudo btrfs-image -c 9 -s -w /dev/dm-1 
/run/media/[...]/btrfsImageWithoutData.bit
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
"""

> > Sep 19 10:16:18 localhost.localdomain kernel: parent transid verify failed on
> > 46678016 wanted 4923 found 3306
> > Sep 19 10:16:18 localhost.localdomain kernel: parent transid verify failed on
> > 46678016 wanted 4923 found 3306
>
> These messages come up often on the list. The notes written in disk-io.c say
> this:
>   * we can't consider a given block up to date unless the transid of the
>   * block matches the transid in the parent node's pointer.  This is how we
>   * detect blocks that either didn't get written at all or got written
>   * in the wrong place.
>
> I don't know whether this definitely means hardware related problems of some
> sort, but it sounds suspiciously like that because blocks should get written in
> the correct place. Right? But they didn't.

While I am not too sure about the underlying harddrive myself, I would 
trust dm-crypt and LUKS. With the XTS disc encryption mode any bit error 
will result in a completely random 16byte block. Also any block (16byte 
AES block or 512byte disk block alike) that is written to the wrong 
place on the harddrive (i.e. on the ciphertext side) will be decrypted 
to a completely random block on the next read. I believe a random block 
of data in the btrfs fs would result in more drastic results than what I 
encounter?

> > Sep 19 10:16:18 localhost.localdomain kernel: BTRFS: Failed to read block
> > groups: -5
>
> This came up in a recent thread "Problem with a filesystem". I'm not sure what
> it means.
>
> Once you've taken the btrfs-image, and you're about ready to toss the file
> system it's worth trying these commands.
>
> btrfs rescue super-recover -v

"""
$ sudo btrfs rescue super-recover -v /dev/dm-1
All Devices:
         Device: id = 1, name = /dev/dm-1

Before Recovering:
         [All good supers]:
                 device name = /dev/dm-1
                 superblock bytenr = 65536

                 device name = /dev/dm-1
                 superblock bytenr = 67108864

                 device name = /dev/dm-1
                 superblock bytenr = 274877906944

         [All bad supers]:

All supers are valid, no need to recover
"""

> ## if it fixes anything, don't continue, try to mount the fs
> btrfs check --repair

"""
$ sudo btrfs check --repair /dev/dm-1
enabling repair mode
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
Checking filesystem on /dev/dm-1
UUID: 8ccbd085-564d-4022-bfc9-18fd429d0a8d
checking extents
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
leaf parent key incorrect 46678016
bad block 46678016
parent transid verify failed on 46661632 wanted 4923 found 3306
parent transid verify failed on 46661632 wanted 4923 found 3306
parent transid verify failed on 46661632 wanted 4923 found 3306
parent transid verify failed on 46661632 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
$ echo $?
139
"""

There was a segfault. Syslog:
"""
Sep 21 11:52:19 localhost.localdomain sudo[8355]: jakob : TTY=pts/2 ; 
PWD=/home/jakob ; USER=root ; COMMAND=/sbin/btrfs check --repair /dev/dm-1
Sep 21 11:52:29 localhost.localdomain kernel: btrfs[8356]: segfault at 
f2 ip 000000000042861b sp 00007fff7766b380 error 6 in btrfs[400000+6b000]
Sep 21 11:52:29 localhost.localdomain abrt-hook-ccpp[8467]: Saved core 
dump of pid 8356 (/usr/sbin/btrfs) to 
/var/tmp/abrt/ccpp-2014-09-21-11:52:29-8356 (4112384 bytes)
Sep 21 11:52:29 localhost.localdomain abrt-server[8468]: Generating 
core_backtrace

"""
The segfault was reported and is tracked here: 
https://retrace.fedoraproject.org/faf/reports/440413/ . I've saved the 
whole report directory, including the coredump, and can supply it to you 
if you are interested.

> ## I'd try mounting even if it doesn't say it's repaired anything

The mount errors are same as before.

> btrfs check --repair --init-extent-tree

"""
$ sudo btrfs check --repair --init-extent-tree /dev/dm-1
[Busting my scroll back buffer, the output ends with]
ref mismatch on [821978726400 486137856] extent item 0, found 1
adding new data backref on 821978726400 root 5 owner 607817 offset 
113304682496 found 1
Backref 821978726400 root 5 owner 607817 offset 113304682496 num_refs 0 
not found in extent tree
Incorrect local backref count on 821978726400 root 5 owner 607817 offset 
113304682496 found 1 wanted 0 back 0x41fcbd0
backpointer mismatch on [821978726400 486137856]
ref mismatch on [822464864256 85581824] extent item 0, found 1
adding new data backref on 822464864256 root 5 owner 607817 offset 
113790820352 found 1
Backref 822464864256 root 5 owner 607817 offset 113790820352 num_refs 0 
not found in extent tree
Incorrect local backref count on 822464864256 root 5 owner 607817 offset 
113790820352 found 1 wanted 0 back 0x41fcd00
backpointer mismatch on [822464864256 85581824]
repaired damaged extent references
checking free space cache
cache and super generation don't match, space cache will be invalidated
checking fs roots
checking csums
checking root refs
found 1663987560 bytes used err is 0
total csum bytes: 764703180
total tree bytes: 1663385600
total fs tree bytes: 815513600
total extent tree bytes: 65536
btree space waste bytes: 199227277
file data blocks allocated: 7189946609664
  referenced 790044979200
Btrfs v3.16
$ echo $?
0
"""

> ## Again try to mount the fs

Works again :)
No output from the mount command, syslog:
"""
Sep 21 12:17:01 localhost.localdomain sudo[25668]: jakob : TTY=pts/2 ; 
PWD=/home/jakob/ccpp-2014-09-21-11:52:29-8356 ; USER=root ; 
COMMAND=/bin/mount /dev/dm-1 /mnt/diverse/
Sep 21 12:17:06 localhost.localdomain kernel: BTRFS info (device dm-1): 
disk space caching is enabled
Sep 21 12:17:07 localhost.localdomain kernel: BTRFS: checking UUID tree
Sep 21 12:17:07 localhost.localdomain kernel: SELinux: initialized (dev 
dm-1, type btrfs), uses xattr
"""

I've tried opening a few files and they appear to be fine. I'll take a 
more thorough look later.

> And report kernel and user space messages.
>
>
> Chris Murphy

Thanks,
Jakob Breier

[-- Attachment #2: btrfsCheckOutput --]
[-- Type: text/plain, Size: 54094 bytes --]

parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
checking extents
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
leaf parent key incorrect 46678016
bad block 46678016
Errors found in extent allocation tree or chunk allocation
checking free space cache
btrfs: csum mismatch on free space cache
checking fs roots
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
root 325 root dir 256 not found
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
root 326 root dir 256 not found
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
root 327 root dir 256 not found
checking csums
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
Error going to next leaf -5
Csum exists for 164847730688-215314120704 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 215314382848-216387416064
Csum exists for 215314382848-216387416064 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 216387678208-233557966848
Csum exists for 216387678208-233557966848 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 233558228992-248561336320
Csum exists for 233558228992-248561336320 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248561598464-248562122752
Csum exists for 248561598464-248562122752 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248563433472-248564219904
Csum exists for 248563433472-248564219904 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248564482048-248566317056
Csum exists for 248564482048-248566317056 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248566841344-248567889920
Csum exists for 248566841344-248567889920 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248568414208-248568676352
Csum exists for 248568414208-248568676352 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248568938496-248570773504
Csum exists for 248568938496-248570773504 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248571297792-248571559936
Csum exists for 248571297792-248571559936 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248572084224-248572870656
Csum exists for 248572084224-248572870656 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248573132800-248574181376
Csum exists for 248573132800-248574181376 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248574443520-248574705664
Csum exists for 248574443520-248574705664 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248574967808-248575492096
Csum exists for 248574967808-248575492096 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248575754240-248577327104
Csum exists for 248575754240-248577327104 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248577589248-248578637824
Csum exists for 248577589248-248578637824 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248578899968-248581259264
Csum exists for 248578899968-248581259264 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248582045696-248582307840
Csum exists for 248582045696-248582307840 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248582569984-248582832128
Csum exists for 248582569984-248582832128 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248583618560-248583880704
Csum exists for 248583618560-248583880704 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 248584142848-253484339200
Csum exists for 248584142848-253484339200 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253485649920-253485912064
Csum exists for 253485649920-253485912064 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253486698496-253487484928
Csum exists for 253486698496-253487484928 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253487747072-253489319936
Csum exists for 253487747072-253489319936 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253489844224-253490892800
Csum exists for 253489844224-253490892800 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253491154944-253491679232
Csum exists for 253491154944-253491679232 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253491941376-253492203520
Csum exists for 253491941376-253492203520 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253492989952-253493514240
Csum exists for 253492989952-253493514240 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253494038528-253494300672
Csum exists for 253494038528-253494300672 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253494562816-253494824960
Csum exists for 253494562816-253494824960 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 253495087104-257181732864
Csum exists for 253495087104-257181732864 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 257181995008-257182257152
Csum exists for 257181995008-257182257152 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 257182519296-257184608256
Csum exists for 257182519296-257184608256 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 257184616448-257186451456
Csum exists for 257184616448-257186451456 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 257186713600-257187762176
Csum exists for 257186713600-257187762176 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 257188024320-257189597184
Csum exists for 257188024320-257189597184 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 257189859328-260075999232
Csum exists for 257189859328-260075999232 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 260076261376-260076515328
Csum exists for 260076261376-260076515328 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 260076523520-264079675392
Csum exists for 260076523520-264079675392 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 264080199680-265858220032
Csum exists for 264080199680-265858220032 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 265858482176-271760424960
Csum exists for 265858482176-271760424960 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 271760949248-271761735680
Csum exists for 271760949248-271761735680 but there is no extent record
parent transid verify failed on 46678016 wanted 4923 found 3306
Ignoring transid failure
There are no extents for csum range 271761997824-272222912512
Csum exists for 271761997824-272222912512 but there is no extent record
Checking filesystem on /dev/dm-1
UUID: 8ccbd085-564d-4022-bfc9-18fd429d0a8d
failed to load free space cache for block group 122435928064
found 120733696 bytes used err is 44
total csum bytes: 0
total tree bytes: 557056
total fs tree bytes: 229376
total extent tree bytes: 81920
btree space waste bytes: 310398
file data blocks allocated: 0
 referenced 0
Btrfs v3.16

Re: Help for creating a useful bugreport

[Chris Murphy]

On Sep 21, 2014, at 4:57 AM, Jakob Breier <Jakob.Breier@rwth-aachen.de> wrote:
> 
> I've tried opening a few files and they appear to be fine. I'll take a more thorough look later.

I'm not sure what to expect with --init-extent-tree after the fact. It might have holes in it (?) seeing as I'm not sure how we get something whole from something that had holes in it, that otherwise couldn't be fixed any other way. So I'd take it with a grain of salt unless someone else says it should be fine.

I'm vaguely remembering something about --init-extent-tree discussed in archives, but can't find it, about maybe it should come with a more dire warning, and that the user would probably want to create a new filesystem after retrieving their data from a fixed file system. I know --init-csum-tree removes all csums, so everything produces checksum errors.

You might want to check for hardware related sources for this corruption though. I don't recall if there was any kind of crash that instigated all of this? Do a 'smartctl -t long' test and also a badblocks -swv (destructive write/read with progress) and see if this turns up any problems with device. Check dmesg after badblocks to see if there are any drive or controller related messages, esp link resets or read or write errors. Last it might be worth a memtest86+ overnight or even better over a weekend.

Something caused this corruption, even on crashes I've not had much worse than orphans needing to be cleaned up on the next boot.


Chris Murphy