Re: jerasure packaging and Ceph

[Loic Dachary <loic@dachary.org>]

[-- Attachment #1: Type: text/plain, Size: 1910 bytes --]

Hi Ken,

On 07/08/2015 19:25, Ken Dreyer wrote:
> Hi Loic,
> 
> I was looking through Ceph's bundled libraries recently and I was
> wondering why Ceph bundles its own copy of jerasure.
> 
> Could you give some background on that? Why don't we link to an separate
> system package?

Mainly because there is no proper non regression testing of the packages found in the distributions. It is absolutely critical for Ceph to ensure there is no regression because it would mean data loss. The packagers do not have that concern in mind right now, nor do they have the infrastructure to run non regression tests, to the best of my knowledge.

Even if they had non regression tests, whenever a new package is published, we would need to run Ceph integration tests before it lands in the distribution repositories to ensure that everything is fine from the Ceph perspective. The recent work with teuthology and OpenStack simplified this quite a lot and anyone can run teuthology now. However the level of coordination it would require between the jerasure packager and the ceph packager is far from what is going on currently.

I offered to package jerasure for Debian to solve that problem in the Debian / Ubuntu realm. I thought a first step to decouple ceph from jerasure could be that I care for jerasure because I have access to the test infrastructure and I understand what Ceph needs. And I could gradually make it possible for any packager to do the same, somehow (I have no idea how to do that, honestly). Unfortunately the person responsible for packaging jerasure did not respond favorably to my offer. Nor does he plan to implement integration or non regression tests.

Hopefully that will change in the future, but for now I think bundling jerasure with Ceph is the best way to preserve the data of our users.

Cheers

> 
> - Ken
> 

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]