* About btrfs chunk tree backups @ 2011-03-03 9:01 Miao Xie 2011-03-03 12:37 ` Josef Bacik 0 siblings, 1 reply; 4+ messages in thread From: Miao Xie @ 2011-03-03 9:01 UTC (permalink / raw) To: Chris Mason, Josef Bacik; +Cc: Linux Btrfs Hi, Chris and Josef Recently, I am interested in chunk tree backups, which is described in Project ideas web. But I found it is hard to be implemented. The description said "make the mappings discoverable via a block device scan so that we can recover from corrupted chunk trees", I think it is hard to find the boundary of each stripe, which is the constituent of the chunks, via a block device scan according to the current on-disk data structures. And besides that, even though we find the stripes of each chunks, we still don't know the order of the stripes in one chunk. So I think chunk tree backups is hard to be implemented. Maybe I made some mistakes in understanding this project idea? Thanks Miao ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: About btrfs chunk tree backups 2011-03-03 9:01 About btrfs chunk tree backups Miao Xie @ 2011-03-03 12:37 ` Josef Bacik 2011-03-08 4:14 ` Miao Xie 0 siblings, 1 reply; 4+ messages in thread From: Josef Bacik @ 2011-03-03 12:37 UTC (permalink / raw) To: Miao Xie; +Cc: Chris Mason, Josef Bacik, Linux Btrfs On Thu, Mar 03, 2011 at 05:01:00PM +0800, Miao Xie wrote: > Hi, Chris and Josef > > Recently, I am interested in chunk tree backups, which is described in > Project ideas web. But I found it is hard to be implemented. > > The description said "make the mappings discoverable via a block device > scan so that we can recover from corrupted chunk trees", I think it is > hard to find the boundary of each stripe, which is the constituent of > the chunks, via a block device scan according to the current on-disk data > structures. And besides that, even though we find the stripes of each > chunks, we still don't know the order of the stripes in one chunk. So > I think chunk tree backups is hard to be implemented. > > Maybe I made some mistakes in understanding this project idea? > We talked about this some earlier this week. This will require a format change, basically we need to put down some metadata at the start of every chunk so that we can scan the disk and find the chunks. This could probably be done in a backwards compatible way, we just need to make sure the space for the block thats used is taken up in the extent tree so old kernels don't write over the block. Thanks, Josef ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: About btrfs chunk tree backups 2011-03-03 12:37 ` Josef Bacik @ 2011-03-08 4:14 ` Miao Xie 2011-03-08 15:09 ` Josef Bacik 0 siblings, 1 reply; 4+ messages in thread From: Miao Xie @ 2011-03-08 4:14 UTC (permalink / raw) To: Josef Bacik; +Cc: Chris Mason, Linux Btrfs On Thu, 3 Mar 2011 07:37:25 -0500, Josef Bacik wrote: > On Thu, Mar 03, 2011 at 05:01:00PM +0800, Miao Xie wrote: >> Hi, Chris and Josef >> >> Recently, I am interested in chunk tree backups, which is described in >> Project ideas web. But I found it is hard to be implemented. >> >> The description said "make the mappings discoverable via a block device >> scan so that we can recover from corrupted chunk trees", I think it is >> hard to find the boundary of each stripe, which is the constituent of >> the chunks, via a block device scan according to the current on-disk data >> structures. And besides that, even though we find the stripes of each >> chunks, we still don't know the order of the stripes in one chunk. So >> I think chunk tree backups is hard to be implemented. >> >> Maybe I made some mistakes in understanding this project idea? >> > > We talked about this some earlier this week. This will require a format change, > basically we need to put down some metadata at the start of every chunk so that > we can scan the disk and find the chunks. This could probably be done in a > backwards compatible way, we just need to make sure the space for the block > thats used is taken up in the extent tree so old kernels don't write over the > block. Thanks, Hi, Josef Is anyone implementing it now? Maybe we can help him to do some work. Thanks Miao > > Josef > ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: About btrfs chunk tree backups 2011-03-08 4:14 ` Miao Xie @ 2011-03-08 15:09 ` Josef Bacik 0 siblings, 0 replies; 4+ messages in thread From: Josef Bacik @ 2011-03-08 15:09 UTC (permalink / raw) To: Miao Xie; +Cc: Josef Bacik, Chris Mason, Linux Btrfs On Tue, Mar 08, 2011 at 12:14:05PM +0800, Miao Xie wrote: > On Thu, 3 Mar 2011 07:37:25 -0500, Josef Bacik wrote: > > On Thu, Mar 03, 2011 at 05:01:00PM +0800, Miao Xie wrote: > >> Hi, Chris and Josef > >> > >> Recently, I am interested in chunk tree backups, which is described in > >> Project ideas web. But I found it is hard to be implemented. > >> > >> The description said "make the mappings discoverable via a block device > >> scan so that we can recover from corrupted chunk trees", I think it is > >> hard to find the boundary of each stripe, which is the constituent of > >> the chunks, via a block device scan according to the current on-disk data > >> structures. And besides that, even though we find the stripes of each > >> chunks, we still don't know the order of the stripes in one chunk. So > >> I think chunk tree backups is hard to be implemented. > >> > >> Maybe I made some mistakes in understanding this project idea? > >> > > > > We talked about this some earlier this week. This will require a format change, > > basically we need to put down some metadata at the start of every chunk so that > > we can scan the disk and find the chunks. This could probably be done in a > > backwards compatible way, we just need to make sure the space for the block > > thats used is taken up in the extent tree so old kernels don't write over the > > block. Thanks, > > Hi, Josef > > Is anyone implementing it now? Maybe we can help him to do some work. > Not that I know of. Thanks, Josef ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2011-03-08 15:09 UTC | newest] Thread overview: 4+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2011-03-03 9:01 About btrfs chunk tree backups Miao Xie 2011-03-03 12:37 ` Josef Bacik 2011-03-08 4:14 ` Miao Xie 2011-03-08 15:09 ` Josef Bacik
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).