* some questions about rbd [not found] <CAB6Jr7QLS1=G0vPavT70knKUteDczF4yho1Bha_Tgsv1tsXusA@mail.gmail.com> @ 2012-10-23 3:10 ` jie sun 2012-10-23 4:21 ` Dan Mick 0 siblings, 1 reply; 6+ messages in thread From: jie sun @ 2012-10-23 3:10 UTC (permalink / raw) To: ceph-devel Hi, I create a image and map it to a virtual machine,and then mkfs and mount it. I want to remove the image from mon server forcely, but it says "Removing image: 99% complete...failed. delete error: image still has watchers This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout." I want to know is there any other way to remove it by force? Thank you. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: some questions about rbd 2012-10-23 3:10 ` some questions about rbd jie sun @ 2012-10-23 4:21 ` Dan Mick [not found] ` <CAB6Jr7QYrugfTModh85JFtkga2zPN_6tKJ1cSMA78+H85ksbcw@mail.gmail.com> 0 siblings, 1 reply; 6+ messages in thread From: Dan Mick @ 2012-10-23 4:21 UTC (permalink / raw) To: jie sun; +Cc: ceph-devel On 10/22/2012 08:10 PM, jie sun wrote: > Hi, > > I create a image and map it to a virtual machine,and then mkfs and mount it. > > I want to remove the image from mon server forcely, but it says > "Removing image: 99% complete...failed. > delete error: image still has watchers > This means the image is still open or the client using it crashed. > Try again after closing/unmapping it or waiting 30s for the crashed > client to timeout." > > I want to know is there any other way to remove it by force? Are you saying the vm still has the device open and is trying to use it? But even so, you want the image to be deleted? ^ permalink raw reply [flat|nested] 6+ messages in thread
[parent not found: <CAB6Jr7QYrugfTModh85JFtkga2zPN_6tKJ1cSMA78+H85ksbcw@mail.gmail.com>]
* Re: some questions about rbd [not found] ` <CAB6Jr7QYrugfTModh85JFtkga2zPN_6tKJ1cSMA78+H85ksbcw@mail.gmail.com> @ 2012-10-23 6:25 ` Dan Mick 2012-10-23 17:47 ` Josh Durgin 0 siblings, 1 reply; 6+ messages in thread From: Dan Mick @ 2012-10-23 6:25 UTC (permalink / raw) To: jie sun; +Cc: ceph-devel I don't think we support that; I'm not sure how hard it would be. Somehow we'd have to keep knowledge of the open image handle around to fail further I/O requests, it seems. Josh? On 10/22/2012 10:44 PM, jie sun wrote: > Yes. I want to delete the image by force, even the vm is still using it. > > 2012/10/23 Dan Mick <dan.mick@inktank.com>: >> >> >> On 10/22/2012 08:10 PM, jie sun wrote: >>> >>> Hi, >>> >>> I create a image and map it to a virtual machine,and then mkfs and mount >>> it. >>> >>> I want to remove the image from mon server forcely, but it says >>> "Removing image: 99% complete...failed. >>> delete error: image still has watchers >>> This means the image is still open or the client using it crashed. >>> Try again after closing/unmapping it or waiting 30s for the crashed >>> client to timeout." >>> >>> I want to know is there any other way to remove it by force? >> >> >> Are you saying the vm still has the device open and is trying to use it? >> But even so, you want the image to be deleted? >> ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: some questions about rbd 2012-10-23 6:25 ` Dan Mick @ 2012-10-23 17:47 ` Josh Durgin 2012-10-25 6:25 ` jie sun 0 siblings, 1 reply; 6+ messages in thread From: Josh Durgin @ 2012-10-23 17:47 UTC (permalink / raw) To: Dan Mick; +Cc: jie sun, ceph-devel Currently there's no way to force deletion of a RADOS object that has watchers. Clients with an rbd image open watch the header object, hence the error you saw. There's a feature request open for this at the RADOS level: http://www.tracker.newdream.net/issues/2339 I'm curious about why you want to delete an image even if a vm is still using it. What's the context in which this becomes necessary? Josh On 10/22/2012 11:25 PM, Dan Mick wrote: > I don't think we support that; I'm not sure how hard it would be. > Somehow we'd have to keep knowledge of the open image handle around to > fail further I/O requests, it seems. Josh? > > On 10/22/2012 10:44 PM, jie sun wrote: >> Yes. I want to delete the image by force, even the vm is still using it. >> >> 2012/10/23 Dan Mick <dan.mick@inktank.com>: >>> >>> >>> On 10/22/2012 08:10 PM, jie sun wrote: >>>> >>>> Hi, >>>> >>>> I create a image and map it to a virtual machine,and then mkfs and >>>> mount >>>> it. >>>> >>>> I want to remove the image from mon server forcely, but it says >>>> "Removing image: 99% complete...failed. >>>> delete error: image still has watchers >>>> This means the image is still open or the client using it crashed. >>>> Try again after closing/unmapping it or waiting 30s for the crashed >>>> client to timeout." >>>> >>>> I want to know is there any other way to remove it by force? >>> >>> >>> Are you saying the vm still has the device open and is trying to use it? >>> But even so, you want the image to be deleted? >>> > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: some questions about rbd 2012-10-23 17:47 ` Josh Durgin @ 2012-10-25 6:25 ` jie sun 2012-10-25 7:27 ` Wido den Hollander 0 siblings, 1 reply; 6+ messages in thread From: jie sun @ 2012-10-25 6:25 UTC (permalink / raw) To: Josh Durgin; +Cc: ceph-devel I'm are about to support a service that vm cloud mount new device dynamically. I'm afraid that sometimes the vm crashed(not totally crashed but just can't be connected with, or the host can't be connected so that I can't remove the vm at all) but the block device is still in use, and the daemon that write or read block device is still alive. Maybe in the situation that we meet a spiteful client and do some operations not allowed. Is it necessary to consider these situations? The wather of the image is on the mon or the osd? Can you tell me what is the priciple of the watcher? some tcp connection(the vm to the osd)? Thank you! 2012/10/24 Josh Durgin <josh.durgin@inktank.com>: > Currently there's no way to force deletion of a RADOS object that > has watchers. Clients with an rbd image open watch the header > object, hence the error you saw. > > There's a feature request open for this at the RADOS level: > http://www.tracker.newdream.net/issues/2339 > > I'm curious about why you want to delete an image even > if a vm is still using it. What's the context in which this > becomes necessary? > > Josh > > > On 10/22/2012 11:25 PM, Dan Mick wrote: >> >> I don't think we support that; I'm not sure how hard it would be. >> Somehow we'd have to keep knowledge of the open image handle around to >> fail further I/O requests, it seems. Josh? >> >> On 10/22/2012 10:44 PM, jie sun wrote: >>> >>> Yes. I want to delete the image by force, even the vm is still using it. >>> >>> 2012/10/23 Dan Mick <dan.mick@inktank.com>: >>>> >>>> >>>> >>>> On 10/22/2012 08:10 PM, jie sun wrote: >>>>> >>>>> >>>>> Hi, >>>>> >>>>> I create a image and map it to a virtual machine,and then mkfs and >>>>> mount >>>>> it. >>>>> >>>>> I want to remove the image from mon server forcely, but it says >>>>> "Removing image: 99% complete...failed. >>>>> delete error: image still has watchers >>>>> This means the image is still open or the client using it crashed. >>>>> Try again after closing/unmapping it or waiting 30s for the crashed >>>>> client to timeout." >>>>> >>>>> I want to know is there any other way to remove it by force? >>>> >>>> >>>> >>>> Are you saying the vm still has the device open and is trying to use it? >>>> But even so, you want the image to be deleted? >>>> >> -- >> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in >> the body of a message to majordomo@vger.kernel.org >> More majordomo info at http://vger.kernel.org/majordomo-info.html > > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: some questions about rbd 2012-10-25 6:25 ` jie sun @ 2012-10-25 7:27 ` Wido den Hollander 0 siblings, 0 replies; 6+ messages in thread From: Wido den Hollander @ 2012-10-25 7:27 UTC (permalink / raw) To: jie sun; +Cc: Josh Durgin, ceph-devel On 10/25/2012 08:25 AM, jie sun wrote: > I'm are about to support a service that vm cloud mount new device dynamically. > I'm afraid that sometimes the vm crashed(not totally crashed but just > can't be connected with, or the host can't be connected so that I > can't remove the vm at all) but the block device is still in use, and > the daemon that write or read block device is still alive. > Maybe in the situation that we meet a spiteful client and do some > operations not allowed. > > Is it necessary to consider these situations? The wather of the image > is on the mon or the osd? Can you tell me what is the priciple of the > watcher? some tcp connection(the vm to the osd)? > If I were you I'd switch to using the build in RBD functionalities of Qemu instead of mounting a block device and running your virtual machine from that device. That would also be a lot easier since you don't have to map/unmap a device. You can also kill a VM much easier since it is not that much tied into the kernel. You should take a look at libvirt and Qemu. Wido > Thank you! > > > 2012/10/24 Josh Durgin <josh.durgin@inktank.com>: >> Currently there's no way to force deletion of a RADOS object that >> has watchers. Clients with an rbd image open watch the header >> object, hence the error you saw. >> >> There's a feature request open for this at the RADOS level: >> http://www.tracker.newdream.net/issues/2339 >> >> I'm curious about why you want to delete an image even >> if a vm is still using it. What's the context in which this >> becomes necessary? >> >> Josh >> >> >> On 10/22/2012 11:25 PM, Dan Mick wrote: >>> >>> I don't think we support that; I'm not sure how hard it would be. >>> Somehow we'd have to keep knowledge of the open image handle around to >>> fail further I/O requests, it seems. Josh? >>> >>> On 10/22/2012 10:44 PM, jie sun wrote: >>>> >>>> Yes. I want to delete the image by force, even the vm is still using it. >>>> >>>> 2012/10/23 Dan Mick <dan.mick@inktank.com>: >>>>> >>>>> >>>>> >>>>> On 10/22/2012 08:10 PM, jie sun wrote: >>>>>> >>>>>> >>>>>> Hi, >>>>>> >>>>>> I create a image and map it to a virtual machine,and then mkfs and >>>>>> mount >>>>>> it. >>>>>> >>>>>> I want to remove the image from mon server forcely, but it says >>>>>> "Removing image: 99% complete...failed. >>>>>> delete error: image still has watchers >>>>>> This means the image is still open or the client using it crashed. >>>>>> Try again after closing/unmapping it or waiting 30s for the crashed >>>>>> client to timeout." >>>>>> >>>>>> I want to know is there any other way to remove it by force? >>>>> >>>>> >>>>> >>>>> Are you saying the vm still has the device open and is trying to use it? >>>>> But even so, you want the image to be deleted? >>>>> >>> -- >>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in >>> the body of a message to majordomo@vger.kernel.org >>> More majordomo info at http://vger.kernel.org/majordomo-info.html >> >> > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2012-10-25 7:27 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <CAB6Jr7QLS1=G0vPavT70knKUteDczF4yho1Bha_Tgsv1tsXusA@mail.gmail.com>
2012-10-23 3:10 ` some questions about rbd jie sun
2012-10-23 4:21 ` Dan Mick
[not found] ` <CAB6Jr7QYrugfTModh85JFtkga2zPN_6tKJ1cSMA78+H85ksbcw@mail.gmail.com>
2012-10-23 6:25 ` Dan Mick
2012-10-23 17:47 ` Josh Durgin
2012-10-25 6:25 ` jie sun
2012-10-25 7:27 ` Wido den Hollander
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.