Cleaning up CephFS pool

Cleaning up CephFS pool

[Denis Fondras]

Hello all,

I noticed that removing files on CephFS doesn't reclaim free space using 
ceph version 0.52(commit:e48859474c4944d4ff201ddc9f5fd400e8898173)

I created 2 500GB files on CephFS (mounted with ceph-fuse) and then 
removed them. Now "rados df -p data" shows a 1GB usage :
--8<----------------
pool name       category                 KB      objects       clones 
   degraded      unfound           rd        rd KB           wr        wr KB
data            -                 1048580595       257696            0 
           0           0            0            0       628853   1629192870
--8<----------------

Is there a way to clean it up ? "rados cleanup" needs a prefix I don't 
know...
Of course, I could "rm" every objects but what if I had other files that 
I don't want to remove from CephFS ?

Thanks in advance,
Denis

Re: Cleaning up CephFS pool

[Gregory Farnum]

Deleting files on CephFS doesn't instantaneously remove the underlying
objects because they could still be in use by other clients, and
removal takes time proportional to the size of the file. Instead the
MDS queues it up to be removed asynchronously. You should see the
number of objects counter going down over time.
-Greg

On Tue, Nov 6, 2012 at 11:21 AM, Denis Fondras <ceph@ledeuns.net> wrote:
> Hello all,
>
> I noticed that removing files on CephFS doesn't reclaim free space using
> ceph version 0.52(commit:e48859474c4944d4ff201ddc9f5fd400e8898173)
>
> I created 2 500GB files on CephFS (mounted with ceph-fuse) and then removed
> them. Now "rados df -p data" shows a 1GB usage :
> --8<----------------
> pool name       category                 KB      objects       clones
> degraded      unfound           rd        rd KB           wr        wr KB
> data            -                 1048580595       257696            0
> 0           0            0            0       628853   1629192870
> --8<----------------
>
> Is there a way to clean it up ? "rados cleanup" needs a prefix I don't
> know...
> Of course, I could "rm" every objects but what if I had other files that I
> don't want to remove from CephFS ?
>
> Thanks in advance,
> Denis
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Cleaning up CephFS pool

[Denis Fondras]

Le 06/11/2012 20:24, Gregory Farnum a écrit :
> Deleting files on CephFS doesn't instantaneously remove the underlying
> objects because they could still be in use by other clients, and
> removal takes time proportional to the size of the file. Instead the
> MDS queues it up to be removed asynchronously. You should see the
> number of objects counter going down over time.
> -Greg
>

Thank you for that fast answer Greg.
If I'm the only user,  is there a way to speedup this process ?

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Cleaning up CephFS pool

[Gregory Farnum]

On Tue, Nov 6, 2012 at 11:29 AM, Denis Fondras <ceph@ledeuns.net> wrote:
>
> Le 06/11/2012 20:24, Gregory Farnum a écrit :
>
>> Deleting files on CephFS doesn't instantaneously remove the underlying
>> objects because they could still be in use by other clients, and
>> removal takes time proportional to the size of the file. Instead the
>> MDS queues it up to be removed asynchronously. You should see the
>> number of objects counter going down over time.
>> -Greg
>>
>
> Thank you for that fast answer Greg.
> If I'm the only user,  is there a way to speedup this process ?

Hrm, I don't think so. Sorry.
It shouldn't actually take that long though once nobody's got the file open.
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html