* Is scrubbing md-aware in any way?
@ 2022-09-13 14:15 Mariusz Mazur
2022-09-13 15:48 ` Lukas Straub
2022-09-14 14:27 ` David Sterba
0 siblings, 2 replies; 6+ messages in thread
From: Mariusz Mazur @ 2022-09-13 14:15 UTC (permalink / raw)
To: linux-btrfs
Hi, it's my understanding that when running a scrub on a btrfs raid,
if data corruption is detected, the process will check copies on other
devices and heal the data if possible.
Is any of that functionality available when running on top of an md
raid? When a scrub notices an issue, does it have any mechanism of
telling md "hey, there's a problem with these sectors" and working
with it to do something about that or is it all up to the admin to
deal with the "file corrupted" message?
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Is scrubbing md-aware in any way?
2022-09-13 14:15 Is scrubbing md-aware in any way? Mariusz Mazur
@ 2022-09-13 15:48 ` Lukas Straub
2022-09-14 14:27 ` David Sterba
1 sibling, 0 replies; 6+ messages in thread
From: Lukas Straub @ 2022-09-13 15:48 UTC (permalink / raw)
To: Mariusz Mazur; +Cc: linux-btrfs
[-- Attachment #1: Type: text/plain, Size: 620 bytes --]
On Tue, 13 Sep 2022 16:15:26 +0200
Mariusz Mazur <mariusz.g.mazur@gmail.com> wrote:
> Hi, it's my understanding that when running a scrub on a btrfs raid,
> if data corruption is detected, the process will check copies on other
> devices and heal the data if possible.
>
> Is any of that functionality available when running on top of an md
> raid? When a scrub notices an issue, does it have any mechanism of
> telling md "hey, there's a problem with these sectors" and working
> with it to do something about that or is it all up to the admin to
> deal with the "file corrupted" message?
No.
--
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Is scrubbing md-aware in any way?
2022-09-13 14:15 Is scrubbing md-aware in any way? Mariusz Mazur
2022-09-13 15:48 ` Lukas Straub
@ 2022-09-14 14:27 ` David Sterba
2022-09-25 18:46 ` Neal Gompa
1 sibling, 1 reply; 6+ messages in thread
From: David Sterba @ 2022-09-14 14:27 UTC (permalink / raw)
To: Mariusz Mazur; +Cc: linux-btrfs
On Tue, Sep 13, 2022 at 04:15:26PM +0200, Mariusz Mazur wrote:
> Hi, it's my understanding that when running a scrub on a btrfs raid,
> if data corruption is detected, the process will check copies on other
> devices and heal the data if possible.
>
> Is any of that functionality available when running on top of an md
> raid?
No, the type of block device under btrfs is considered the same in all
cases, except zoned devices, so any advanced information exchange or
control like devices reporting bad sectors or btrfs asking to repair the
underlying device by its own means.
> When a scrub notices an issue, does it have any mechanism of
> telling md "hey, there's a problem with these sectors" and working
> with it to do something about that or is it all up to the admin to
> deal with the "file corrupted" message?
It's up to the admin. I've looked if there's some API outside of the
md-raid implementation, but there's none so it would have to be created
first in for the btrfs <-> md cooperation.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Is scrubbing md-aware in any way?
2022-09-14 14:27 ` David Sterba
@ 2022-09-25 18:46 ` Neal Gompa
2022-09-26 15:36 ` Mariusz Mazur
0 siblings, 1 reply; 6+ messages in thread
From: Neal Gompa @ 2022-09-25 18:46 UTC (permalink / raw)
To: dsterba; +Cc: Mariusz Mazur, linux-btrfs
On Wed, Sep 14, 2022 at 10:37 AM David Sterba <dsterba@suse.cz> wrote:
>
> On Tue, Sep 13, 2022 at 04:15:26PM +0200, Mariusz Mazur wrote:
> > Hi, it's my understanding that when running a scrub on a btrfs raid,
> > if data corruption is detected, the process will check copies on other
> > devices and heal the data if possible.
> >
> > Is any of that functionality available when running on top of an md
> > raid?
>
> No, the type of block device under btrfs is considered the same in all
> cases, except zoned devices, so any advanced information exchange or
> control like devices reporting bad sectors or btrfs asking to repair the
> underlying device by its own means.
>
> > When a scrub notices an issue, does it have any mechanism of
> > telling md "hey, there's a problem with these sectors" and working
> > with it to do something about that or is it all up to the admin to
> > deal with the "file corrupted" message?
>
> It's up to the admin. I've looked if there's some API outside of the
> md-raid implementation, but there's none so it would have to be created
> first in for the btrfs <-> md cooperation.
IIRC, the Synology folks created such an API for their own use-case.
Does anyone on-list know the folks at Synology to see if they'd be
interested in working with us and the md folks to make this fully
supported upstream?
--
真実はいつも一つ！/ Always, there's only one truth!
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Is scrubbing md-aware in any way?
2022-09-25 18:46 ` Neal Gompa
@ 2022-09-26 15:36 ` Mariusz Mazur
2022-09-29 10:38 ` David Sterba
0 siblings, 1 reply; 6+ messages in thread
From: Mariusz Mazur @ 2022-09-26 15:36 UTC (permalink / raw)
To: Neal Gompa; +Cc: dsterba, linux-btrfs
niedz., 25 wrz 2022 o 20:46 Neal Gompa <ngompa13@gmail.com> napisał(a):
>
> On Wed, Sep 14, 2022 at 10:37 AM David Sterba <dsterba@suse.cz> wrote:
> >
> > On Tue, Sep 13, 2022 at 04:15:26PM +0200, Mariusz Mazur wrote:
> > > Hi, it's my understanding that when running a scrub on a btrfs raid,
> > > if data corruption is detected, the process will check copies on other
> > > devices and heal the data if possible.
> > >
> > > Is any of that functionality available when running on top of an md
> > > raid?
> >
> > No, the type of block device under btrfs is considered the same in all
> > cases, except zoned devices, so any advanced information exchange or
> > control like devices reporting bad sectors or btrfs asking to repair the
> > underlying device by its own means.
> >
> > > When a scrub notices an issue, does it have any mechanism of
> > > telling md "hey, there's a problem with these sectors" and working
> > > with it to do something about that or is it all up to the admin to
> > > deal with the "file corrupted" message?
> >
> > It's up to the admin. I've looked if there's some API outside of the
> > md-raid implementation, but there's none so it would have to be created
> > first in for the btrfs <-> md cooperation.
>
> IIRC, the Synology folks created such an API for their own use-case.
> Does anyone on-list know the folks at Synology to see if they'd be
> interested in working with us and the md folks to make this fully
> supported upstream?
>
>
> --
> 真実はいつも一つ！/ Always, there's only one truth!
Yes, wondering how synology uses btrfs on top of md raid effectively
is what prompted my question. I'd like to be able to use btrfs (and
other filesystems) in such a fashion as well.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: Is scrubbing md-aware in any way?
2022-09-26 15:36 ` Mariusz Mazur
@ 2022-09-29 10:38 ` David Sterba
0 siblings, 0 replies; 6+ messages in thread
From: David Sterba @ 2022-09-29 10:38 UTC (permalink / raw)
To: Mariusz Mazur; +Cc: Neal Gompa, linux-btrfs
On Mon, Sep 26, 2022 at 05:36:04PM +0200, Mariusz Mazur wrote:
> niedz., 25 wrz 2022 o 20:46 Neal Gompa <ngompa13@gmail.com> napisał(a):
> >
> > On Wed, Sep 14, 2022 at 10:37 AM David Sterba <dsterba@suse.cz> wrote:
> > >
> > > On Tue, Sep 13, 2022 at 04:15:26PM +0200, Mariusz Mazur wrote:
> > > > Hi, it's my understanding that when running a scrub on a btrfs raid,
> > > > if data corruption is detected, the process will check copies on other
> > > > devices and heal the data if possible.
> > > >
> > > > Is any of that functionality available when running on top of an md
> > > > raid?
> > >
> > > No, the type of block device under btrfs is considered the same in all
> > > cases, except zoned devices, so any advanced information exchange or
> > > control like devices reporting bad sectors or btrfs asking to repair the
> > > underlying device by its own means.
> > >
> > > > When a scrub notices an issue, does it have any mechanism of
> > > > telling md "hey, there's a problem with these sectors" and working
> > > > with it to do something about that or is it all up to the admin to
> > > > deal with the "file corrupted" message?
> > >
> > > It's up to the admin. I've looked if there's some API outside of the
> > > md-raid implementation, but there's none so it would have to be created
> > > first in for the btrfs <-> md cooperation.
> >
> > IIRC, the Synology folks created such an API for their own use-case.
> > Does anyone on-list know the folks at Synology to see if they'd be
> > interested in working with us and the md folks to make this fully
> > supported upstream?
>
> Yes, wondering how synology uses btrfs on top of md raid effectively
> is what prompted my question. I'd like to be able to use btrfs (and
> other filesystems) in such a fashion as well.
IIRC the synology kernel sources are available as some .tar or .rpm
file, I don't know if there are the separate patches available anywhere.
Also it's up to synology ty upstream the patches. We've got some btrfs
patches from them that were good, but adding the MD API itself seems to
be an extensive change and harder to get accepted upstream. I haven't
seen the code so I can't say how much it would be intrusive to the btrfs
code but with enough cleanups and abstractions everything is possible.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2022-09-29 10:43 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2022-09-13 14:15 Is scrubbing md-aware in any way? Mariusz Mazur
2022-09-13 15:48 ` Lukas Straub
2022-09-14 14:27 ` David Sterba
2022-09-25 18:46 ` Neal Gompa
2022-09-26 15:36 ` Mariusz Mazur
2022-09-29 10:38 ` David Sterba
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).