crashblk: a block device crash emulator.

crashblk: a block device crash emulator.

[Takashi HOSHINO]

Hi all,

I'm developing 'crashblk'.
It is a memory block device driver to emulate crash, IO error,
and various response time.

The source code repository is here:
https://github.com/starpos/crashblk/

It is very useful to test wrapper block device drivers,
and must be useful to test filesystems also.
I used it to test WalB (https://walb-linux.github.io/),
which is a wrapper block device driver for backup and asynchronous
replication, and found/confirmed several bugs.

If you are interested in crashblk, try it and give me feedback!
Thank you.

Takashi

Re: crashblk: a block device crash emulator.

[Andreas Dilger]

[-- Attachment #1: Type: text/plain, Size: 1067 bytes --]

On Jan 13, 2016, at 6:50 PM, Takashi HOSHINO <hoshino@labs.cybozu.co.jp> wrote:
> 
> Hi all,
> 
> I'm developing 'crashblk'.
> It is a memory block device driver to emulate crash, IO error,
> and various response time.

Why not use/improve dm-flakey for this, rather than making yet another
device that does something similar?

Cheers, Andreas

> The source code repository is here:
> https://github.com/starpos/crashblk/
> 
> It is very useful to test wrapper block device drivers,
> and must be useful to test filesystems also.
> I used it to test WalB (https://walb-linux.github.io/),
> which is a wrapper block device driver for backup and asynchronous
> replication, and found/confirmed several bugs.
> 
> If you are interested in crashblk, try it and give me feedback!
> Thank you.
> 
> Takashi
> --
> To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html


Cheers, Andreas






[-- Attachment #2: Message signed with OpenPGP using GPGMail --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: crashblk: a block device crash emulator.

[Takashi HOSHINO]

Hi Andreas,

On 2016/01/15 4:44, Andreas Dilger wrote:
> On Jan 13, 2016, at 6:50 PM, Takashi HOSHINO <hoshino@labs.cybozu.co.jp> wrote:
>>
>> Hi all,
>>
>> I'm developing 'crashblk'.
>> It is a memory block device driver to emulate crash, IO error,
>> and various response time.
>
> Why not use/improve dm-flakey for this, rather than making yet another
> device that does something similar?

I did not know dm-flakey until your reply. Thank you.

I read its documents and code a bit.
The big purpose of two projects are the same, which is to test software 
on block devices with errors, but their functions are almost different.

It may be nice idea to implement alternative implementation of crashblk 
on device-mapper version by someone.
Currently I'm not familiar with device-mapper development, and I do not 
have any motivation with it.

Thanks, Takashi

> Cheers, Andreas
>
>> The source code repository is here:
>> https://github.com/starpos/crashblk/
>>
>> It is very useful to test wrapper block device drivers,
>> and must be useful to test filesystems also.
>> I used it to test WalB (https://walb-linux.github.io/),
>> which is a wrapper block device driver for backup and asynchronous
>> replication, and found/confirmed several bugs.
>>
>> If you are interested in crashblk, try it and give me feedback!
>> Thank you.
>>
>> Takashi
>> --
>> To unsubscribe from this list: send the line "unsubscribe linux-fsdevel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
>
> Cheers, Andreas

Re: crashblk: a block device crash emulator.

[Josef Bacik]

On 01/15/2016 01:45 AM, Takashi HOSHINO wrote:
> Hi Andreas,
>
> On 2016/01/15 4:44, Andreas Dilger wrote:
>> On Jan 13, 2016, at 6:50 PM, Takashi HOSHINO
>> <hoshino@labs.cybozu.co.jp> wrote:
>>>
>>> Hi all,
>>>
>>> I'm developing 'crashblk'.
>>> It is a memory block device driver to emulate crash, IO error,
>>> and various response time.
>>
>> Why not use/improve dm-flakey for this, rather than making yet another
>> device that does something similar?
>
> I did not know dm-flakey until your reply. Thank you.
>
> I read its documents and code a bit.
> The big purpose of two projects are the same, which is to test software
> on block devices with errors, but their functions are almost different.
>
> It may be nice idea to implement alternative implementation of crashblk
> on device-mapper version by someone.
> Currently I'm not familiar with device-mapper development, and I do not
> have any motivation with it.
>

There's also dm-log-writes which will log writes to an external journal 
to allow you to replay writes and verify the fs is consistent at all 
steps of operation.  Thanks,

Josef

Re: crashblk: a block device crash emulator.

[Takashi HOSHINO]

On 2016/01/16 5:09, Josef Bacik wrote:
> On 01/15/2016 01:45 AM, Takashi HOSHINO wrote:
>> Hi Andreas,
>>
>> On 2016/01/15 4:44, Andreas Dilger wrote:
>>> On Jan 13, 2016, at 6:50 PM, Takashi HOSHINO
>>> <hoshino@labs.cybozu.co.jp> wrote:
>>>>
>>>> Hi all,
>>>>
>>>> I'm developing 'crashblk'.
>>>> It is a memory block device driver to emulate crash, IO error,
>>>> and various response time.
>>>
>>> Why not use/improve dm-flakey for this, rather than making yet another
>>> device that does something similar?
>>
>> I did not know dm-flakey until your reply. Thank you.
>>
>> I read its documents and code a bit.
>> The big purpose of two projects are the same, which is to test software
>> on block devices with errors, but their functions are almost different.
>>
>> It may be nice idea to implement alternative implementation of crashblk
>> on device-mapper version by someone.
>> Currently I'm not familiar with device-mapper development, and I do not
>> have any motivation with it.
>>
>
> There's also dm-log-writes which will log writes to an external journal
> to allow you to replay writes and verify the fs is consistent at all
> steps of operation.  Thanks,

My colleague let me know about dm-log-writes several months ago and I 
read its code. Its very small and nice! (<1000 lines)
I felt it is useful to DEBUG file systems or wrapper devices but not 
useful to TEST them because it will tell us too much information.

BTW, our another software WalB, which is our primary test target of 
crashblk, also log-writes to an journal device.
Its primary usage is to backup devices incrementally or to replicate 
them, while it may also useful for debug purpose.
But WalB uses journals not only to extract logs for replay but also to 
keep consistency and control durability of data like some filesystems, 
so it requires more code.

Thanks,

Takashi