Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

[Florian Haas]

Hi everyone,

apologies for the cross-post, and not sure if this is new information.
I did do a cursory check of both list archives and didn't find
anything pertinent, so here goes. Feel free to point me to an existing
thread if I'm merely regurgitating something that's already known.

Either I'm doing something terribly wrong, or the current state of
OpenStack/Ceph integration in Ubuntu precise is somewhat suboptimal.
At least as far as sticking to packages available in Ubuntu repos is
concerned.

Steps to reproduce:

1. On an installation using 12.04 with current updates, create a RADOS pool.
2. Configure glance to use "rbd" as its backend storage.
3. Attempt to upload an image.

glance add name="Ubuntu 12.04 cloudimg amd64" is_public=true
container_format=ovf disk_format=qcow2 <
precise-server-cloudimg-amd64-disk1.img
Uploading image 'Ubuntu 12.04 cloudimg amd64'
==============================================================================================[
92%]         222.109521M/s, ETA  0h  0m  0sFailed to add image. Got
error:
Data supplied was not valid.
Details: 400 Bad Request

The server could not comply with the request since it is either
malformed or otherwise incorrect.

 Error uploading image: (NameError): global name 'rados' is not defined

Digging around in glance/store/rbd.py yields this:

try:
    import rados
    import rbd
except ImportError:
    pass

I will go so far as say the error handling here could be improved --
however, the Swift store implementation seems to do the same.

Now, in Ubuntu rados.py and rbd.py ship in the python-ceph package,
which is available in universe, but has an unresolvable dependency on
librgw1. librgw1 apparently had been in Ubuntu for quite a while, but
was dropped just before the Essex release:

https://launchpad.net/ubuntu/precise/amd64/radosgw

... and if I read
http://changelogs.ubuntu.com/changelogs/pool/main/c/ceph/ceph_0.41-1ubuntu2/changelog
correctly, then the rationale for it was to "drop radosgw since
libfcgi is not in main and the code may not be suitable for LTS." (I
wonder why this wasn't factored out into a separate package then, as
was apparently the case for ceph-mds).

Does this really mean that radosgw functionality was dropped from
Ubuntu because it wasn't considered ready for main, and now it
completely breaks a package in universe that's essential for
Ceph/OpenStack integration? AFAICT the only thing that would be
unaffected by this would be nova-volume (now cinder) which rather than
using the Ceph Python bindings just calls out to the rados and rbd
binaries. But both the glance RBD store and the RADOS Swift and S3
frontends (via radosgw) would be affected.

This can of course all be fixed by using "upstream" packages from the
Ceph guys (thanks to Sébastien Han for pointing that out to me).

Anyone able to confirm or refute these findings? Should there be an
Ubuntu bug for this? If so, against what package?

Cheers,
Florian
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

[Josh Durgin]

Hi Florian,

There's an Ubuntu bug already:

https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/981130

librgw was not complete, and wasn't actually used by radosgw, so it was
dropped. The Ubuntu package just needs to be updated to remove the
dependency and rgw.py, like upstream did.

Josh

On 06/08/2012 08:24 AM, Florian Haas wrote:
> Hi everyone,
>
> apologies for the cross-post, and not sure if this is new information.
> I did do a cursory check of both list archives and didn't find
> anything pertinent, so here goes. Feel free to point me to an existing
> thread if I'm merely regurgitating something that's already known.
>
> Either I'm doing something terribly wrong, or the current state of
> OpenStack/Ceph integration in Ubuntu precise is somewhat suboptimal.
> At least as far as sticking to packages available in Ubuntu repos is
> concerned.
>
> Steps to reproduce:
>
> 1. On an installation using 12.04 with current updates, create a RADOS pool.
> 2. Configure glance to use "rbd" as its backend storage.
> 3. Attempt to upload an image.
>
> glance add name="Ubuntu 12.04 cloudimg amd64" is_public=true
> container_format=ovf disk_format=qcow2<
> precise-server-cloudimg-amd64-disk1.img
> Uploading image 'Ubuntu 12.04 cloudimg amd64'
> ==============================================================================================[
> 92%]         222.109521M/s, ETA  0h  0m  0sFailed to add image. Got
> error:
> Data supplied was not valid.
> Details: 400 Bad Request
>
> The server could not comply with the request since it is either
> malformed or otherwise incorrect.
>
>   Error uploading image: (NameError): global name 'rados' is not defined
>
> Digging around in glance/store/rbd.py yields this:
>
> try:
>      import rados
>      import rbd
> except ImportError:
>      pass
>
> I will go so far as say the error handling here could be improved --
> however, the Swift store implementation seems to do the same.
>
> Now, in Ubuntu rados.py and rbd.py ship in the python-ceph package,
> which is available in universe, but has an unresolvable dependency on
> librgw1. librgw1 apparently had been in Ubuntu for quite a while, but
> was dropped just before the Essex release:
>
> https://launchpad.net/ubuntu/precise/amd64/radosgw
>
> ... and if I read
> http://changelogs.ubuntu.com/changelogs/pool/main/c/ceph/ceph_0.41-1ubuntu2/changelog
> correctly, then the rationale for it was to "drop radosgw since
> libfcgi is not in main and the code may not be suitable for LTS." (I
> wonder why this wasn't factored out into a separate package then, as
> was apparently the case for ceph-mds).
>
> Does this really mean that radosgw functionality was dropped from
> Ubuntu because it wasn't considered ready for main, and now it
> completely breaks a package in universe that's essential for
> Ceph/OpenStack integration? AFAICT the only thing that would be
> unaffected by this would be nova-volume (now cinder) which rather than
> using the Ceph Python bindings just calls out to the rados and rbd
> binaries. But both the glance RBD store and the RADOS Swift and S3
> frontends (via radosgw) would be affected.
>
> This can of course all be fixed by using "upstream" packages from the
> Ceph guys (thanks to Sébastien Han for pointing that out to me).
>
> Anyone able to confirm or refute these findings? Should there be an
> Ubuntu bug for this? If so, against what package?
>
> Cheers,
> Florian
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

[Florian Haas]

On Fri, Jun 8, 2012 at 5:48 PM, Josh Durgin <josh.durgin@inktank.com> wrote:
> Hi Florian,
>
> There's an Ubuntu bug already:
>
> https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/981130
>
> librgw was not complete, and wasn't actually used by radosgw, so it was
> dropped. The Ubuntu package just needs to be updated to remove the
> dependency and rgw.py, like upstream did.

Thanks Josh -- could an Ubuntu person weigh on on this? This has me
wondering whether this is going to be fixed in precise.

Changed in ceph (Ubuntu):
milestone:	 ubuntu-12.04.1 → quantal-alpha-1

... is what the bug report says.

Cheers,
Florian
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: [Openstack] Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

[Florian Haas]

On Fri, Jun 8, 2012 at 5:59 PM, James Page <james.page@ubuntu.com> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA256
>
> Hi Josh
>
> On 08/06/12 16:48, Josh Durgin wrote:
>> There's an Ubuntu bug already:
>>
>> https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/981130
>>
>> librgw was not complete, and wasn't actually used by radosgw, so it
>> was dropped. The Ubuntu package just needs to be updated to remove
>> the dependency and rgw.py, like upstream did.
>
> You can type faster than I can... I'm working on getting this resolved
> in the current dev release of Ubuntu in the next few days after which
> it will go through the normal SRU process for Ubuntu 12.04.

Sweet, thanks!

Cheers,
Florian

Re: [Openstack] Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

[James Page]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Hi Florian

On 08/06/12 17:11, Florian Haas wrote:
>>> Hi Josh
>>> 
>>> On 08/06/12 16:48, Josh Durgin wrote:
>>>>> There's an Ubuntu bug already:
>>>>> 
>>>>> https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/981130
>>>>> 
>>>>> librgw was not complete, and wasn't actually used by
>>>>> radosgw, so it was dropped. The Ubuntu package just needs
>>>>> to be updated to remove the dependency and rgw.py, like
>>>>> upstream did.
>>> 
>>> You can type faster than I can... I'm working on getting this
>>> resolved in the current dev release of Ubuntu in the next few
>>> days after which it will go through the normal SRU process for
>>> Ubuntu 12.04.
> Sweet, thanks!

The SRU to resolve the install-ability of python-ceph have just
complete verification and should be available in Ubuntu 12.04 updates
in the next few hours (depending on which mirror you use).

Cheers

James

- -- 
James Page
Ubuntu Core Developer
Debian Maintainer
james.page@ubuntu.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQIcBAEBCAAGBQJP43lOAAoJEL/srsug59jDDJIP/2D19BaGN04rycrPHfIzlApX
r8Tb0Du2B1pskRyN+cPZ6fW7ygjgbM/ZWFd3g1ozg1cpWCiTK6w2Y0NmMQqe/f0G
nCVewI5bhvPFD2roGPJx6LqfK8qHA53CVjJUeqlhKbsUajNCybr6Fpgi3Nknt5u/
kZ0CVu3BQKhR2x6hZkwxMm87gGRAz/Z2rD+BkmErVcYfMHEdA8BajABz9CePexeB
1tlN5/PeAMbC5mNQTsx+QtpGd64KJNx/oRBzJxyUCEP07rPbNI7a3ZmQsvhXiNtc
EoZPhd/JoL/RKHJRB13e8NIc7jPqtqfHy1Un5nqCIDZurtlLnAT4Qo0m0wh70Xv8
rSShpRMe9n6ob/7T1n2iu4XYWdXNFoAaggZ6lrNkJLSMCr+NOhYwjdk4qVlP5oQJ
39aPcribmnEYymf6eVqqGGxpvHwUHvI6zdLm58zTwMpkymdtZdhC12W6O5rT3AG7
B0wXtvmUK23rtA0RdAIT8/gSTdMQ8cLcMqqLxEx0VQQ/Ma0LEBQhGy3zUuPElEZC
SGnqSmKif7LENQr+hAAsOYNIo3uqPamqStzHuWnh0sa2mStOM9LaFife6pWbJizt
MvwKNzTftiWc8LwkM+VvjYuhnMjTXo9XbXxKkT5sadGj+THG+RZTdizqKIywL9vX
+ZvnnBKr3+M00jJqjX0J
=ID+V
-----END PGP SIGNATURE-----

Re: [Openstack] Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

[Florian Haas]

On Fri, Jun 22, 2012 at 7:43 AM, James Page <james.page@ubuntu.com> wrote:
>>>> You can type faster than I can... I'm working on getting this
>>>> resolved in the current dev release of Ubuntu in the next few
>>>> days after which it will go through the normal SRU process for
>>>> Ubuntu 12.04.
>> Sweet, thanks!
>
> The SRU to resolve the install-ability of python-ceph have just
> complete verification and should be available in Ubuntu 12.04 updates
> in the next few hours (depending on which mirror you use).

Excellent. Thanks a lot!

Cheers,
Florian

Re: Ceph/OpenStack integration on Ubuntu precise: horribly broken, or am I doing something wrong?

[Tommi Virtanen]

On Fri, Jun 8, 2012 at 8:24 AM, Florian Haas <florian@hastexo.com> wrote:
> This can of course all be fixed by using "upstream" packages from the
> Ceph guys (thanks to Sébastien Han for pointing that out to me).

Yup. And I think that is the line you will be hearing for 12.04, I
believe. Use 12.04 as the base OS, then install newer ceph debs on top
of that.
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html