Re: v0.38 released

[Andre Noll <maan@systemlinux.org>]

[-- Attachment #1: Type: text/plain, Size: 2962 bytes --]

On Thu, Nov 10, 21:14, Sage Weil wrote:
>  * osd: some peering refactoring
>  * osd: 'replay' period is per-pool (now only affects fs data pool)
>  * osd: clean up old osdmaps
>  * osd: allow admin to revert lost objects to prior versions (or delete)
>  * mkcephfs: generate reasonable crush map based on 'host' and 'rack' 
>    fields in [osd.NN] sections of ceph.conf
>  * radosgw: bucket index improvements
>  * radosgw: improved swift support
>  * rbd: misc command line tool fixes
>  * debian: misc packaging fixes (including dependency breakage on upgrades)
>  * ceph: query daemon perfcounters via command line tool
> 
> The big upcoming items for v0.39 are RBD layering (image cloning), further 
> improvements to radosgw's Swift support, and some monitor failure recovery 
> and bootstrapping improvements.  We're also continuing work on the 
> automation bits that the Chef cookbooks and Juju charms will use, and a 
> Crowbar barclamp was also just posted on github.  Several patches are 
> still working their way into libvirt and qemu to improve support for RBD 
> authentication.

Any plans to address the ENOSPC issue? I gave v0.38 a try and the
file system behaves like the older (<= 0.36) versions I've tried
before when it fills up: The ceph mounts hang on all clients.

But there is progress: Sync is now interuptable (it used to block
in D state so that it could not be killed even with SIGKILL), and
umount works even if the file system is full. However, subsequent
mount attempts then fail with "mount error 5 = Input/output error".

Our test setup consists of one mds, one monitor and 8 osds. mds and
monitor are on the same node, and this node is not not an osd. All
nodes are running Linux-3.0.9 ATM, but I would be willing to upgrade
to 3.1.1 if this is expected to make a difference.

Here's some output of "ceph -w". Funny enough it reports 770G of free
disk space space although the writing process terminated with ENOSPC.

2011-11-15 12:12:45.388535    pg v38805: 65940 pgs: 1956 creating, 63984 active+clean; 1856 GB data, 3730 GB used, 770 GB / 4600 GB avail
2011-11-15 12:12:45.589228   mds e4: 1/1/1 up {0=0=up:active}
2011-11-15 12:12:45.589326   osd e11: 8 osds: 8 up, 8 in full
2011-11-15 12:12:45.589908   log 2011-11-15 12:12:19.599894 osd.326 192.168.3.26:6800/1673 168 : [INF] 0.593 scrub ok
2011-11-15 12:12:45.590000   mon e1: 1 mons at {0=192.168.3.34:6789/0}
2011-11-15 12:12:49.554163    pg v38806: 65940 pgs: 1956 creating, 63984 active+clean; 1856 GB data, 3730 GB used, 770 GB / 4600 GB avail
2011-11-15 12:12:54.526661    pg v38807: 65940 pgs: 1956 creating, 63984 active+clean; 1856 GB data, 3730 GB used, 770 GB / 4600 GB avail
2011-11-15 12:12:56.309292    pg v38808: 65940 pgs: 1956 creating, 63984 active+clean; 1856 GB data, 3730 GB used, 770 GB / 4600 GB avail

Thanks
Andre
-- 
The only person who always got his work done by Friday was Robinson Crusoe

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]