public inbox for linux-btrfs@vger.kernel.org
 help / color / mirror / Atom feed
From: Qu Wenruo <quwenruo.btrfs@gmx.com>
To: Daniel Brunner <daniel@brunner.ninja>, linux-btrfs@vger.kernel.org
Subject: Re: Corrupted files support needed
Date: Tue, 16 Apr 2019 15:56:33 +0800	[thread overview]
Message-ID: <6947fcc2-7db9-d796-0ed6-308ef8110d72@gmx.com> (raw)
In-Reply-To: <CAD7Y51jX2x39tLaDOL9LcBxSmGecG92-Xytku0TWsU4B5d=EcA@mail.gmail.com>


[-- Attachment #1.1: Type: text/plain, Size: 3116 bytes --]



On 2019/4/16 下午3:46, Daniel Brunner wrote:
> Hi,
> 
> thanks for the quick response.
> 
> The filesystem went read-only on its own right at the first read error.

Then the fs metadata should get corrupted.

> I unmounted all mounts and rebooted (just to be sure).
> 
> I ran the command you suggested with --progress
> All output is flushed away with thousands of lines like those at the
> end of the log paste.

Then please stop that running command, as it won't help much.

Regular "btrfs check --readonly" should be able to report the metadata
corruption.

> 
> Does it make sense to let it run until the end or can I assume that 2
> drives are bad?

No need to continue, there should be some metadata corruption.

Above command should report something.

For the device corruption part, I'm not sure. But I think there is
definitely something wrong.

Please start salvage your data, as I'm afraid the fs is already damaged,
although not sure how serious it is.

Thanks,
Qu

> Also I checked SMART values but they seem to be ok.
> 
> https://0x0.st/zNg6.log
> 
> -- Daniel
> 
> Am Mo., 15. Apr. 2019 um 13:58 Uhr schrieb Qu Wenruo <quwenruo.btrfs@gmx.com>:
>>
>>
>>
>> On 2019/4/15 下午7:44, Daniel Brunner wrote:
>>> Hi,
>>>
>>> after normal a reboot I noticed that many files fail to open / read
>>> (Input/Output error). I don't really have a backup of it (only
>>> snapshots which also seem to be corrupted too).
>>> The machine is remote, I can only ssh into it (at the moment). The
>>> raid consists of 8x 10TB drives.
>>>
>>> System & Metadata is RAID1
>>> Data is RAID6
>>>
>>> kernel is the most recent from arch linux repositories:
>>> 5.0.7-arch1-1-ARCH #1 SMP PREEMPT Mon Apr 8 10:37:08 UTC 2019 x86_64 GNU/Linux
>>>
>>> Disk layout & usage:
>>> https://0x0.st/zNBl.log
>>>
>>> Output of btrfs check:
>>> https://0x0.st/zNJs.log
>>
>> Strange, btrfs check reports no error at all.
>>
>> Would you please try btrfs check unmounted just in case.
>>
>>>
>>> Kernel messages:
>>> http://cwillu.com:8080/84.115.44.105/2
>>
>> According to the dmesg, it looks like one device is bad, affecting both
>> data and metadata.
>>
>> And thanks to recent RAID6 enhancement to try all possible mirror
>> combination, it doesn't cause too many problem to metadata at least.
>>
>> Although data csum is not that good.
>> Quite a lot of combination doesn't match checksum, and even more, some
>> check doesn't exist in csum tree.
>>
>> An unmounted btrfs check is recommended.
>> # btrfs check --check-data-csum --readonly
>>
>> This would be better than scrub.
>>
>> And please check the SMART info, some devices look suspicious.
>>
>> Also, please remount the fs read only at least to prevent further
>> corruption.
>>
>> Thanks,
>> Qu
>>
>>>
>>> btrfs scrub is running but it seems like it will take weeks to finish...
>>>
>>> Do you think my data is gone or is there anything I can try? An rsync
>>> is already running, but every 5th file fails to read.
>>>
>>> Best regards,
>>> Daniel
>>>
>>


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

  reply	other threads:[~2019-04-16  7:56 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <CAD7Y51iQMJQiTBBW9AqQ_-aJ6A4fMVEswyNwPMYnj5iAaLOXjw@mail.gmail.com>
2019-04-15 11:44 ` Corrupted files support needed Daniel Brunner
2019-04-15 11:58   ` Qu Wenruo
2019-04-16  7:46     ` Daniel Brunner
2019-04-16  7:56       ` Qu Wenruo [this message]
2019-04-16  8:00       ` Roman Mamedov
2019-04-17 11:16         ` Daniel Brunner
2019-04-17 12:42           ` Qu Wenruo

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=6947fcc2-7db9-d796-0ed6-308ef8110d72@gmx.com \
    --to=quwenruo.btrfs@gmx.com \
    --cc=daniel@brunner.ninja \
    --cc=linux-btrfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox