Article about Object Store API

Article about Object Store API

[Marcel Lauhoff]

Hi,

I wrote an article about the object store API - How it works and looks
like with a focus on how to add something new.

http://irq0.org/articles/ceph/objectstore

Maybe its useful for somebody.. Feedback is greatly appreciated!



[ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
and will probably write something more about other parts of Ceph
crossing my way in the near future :) ]


~marcel


--
Marcel Lauhoff
Mail/XMPP: ml@irq0.org
http://irq0.org

Re: Article about Object Store API

[Gregory Farnum]

Nifty; it's good to have that sort of blog-style documentation about
the interface. Are you planning to do some work with it that you can
show off as well? :)
-Greg

On Tue, Jan 27, 2015 at 12:48 PM, Marcel Lauhoff <ml@irq0.org> wrote:
>
> Hi,
>
> I wrote an article about the object store API - How it works and looks
> like with a focus on how to add something new.
>
> http://irq0.org/articles/ceph/objectstore
>
> Maybe its useful for somebody.. Feedback is greatly appreciated!
>
>
>
> [ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
> and will probably write something more about other parts of Ceph
> crossing my way in the near future :) ]
>
>
> ~marcel
>
>
> --
> Marcel Lauhoff
> Mail/XMPP: ml@irq0.org
> http://irq0.org
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Article about Object Store API

[Loic Dachary]

[-- Attachment #1: Type: text/plain, Size: 1589 bytes --]

Hi Marcel,

I'll bookmark this: useful high level view to get oriented when going back to this part of the code. I have the same question as Greg actually. It looks like you're tempted to try a new objectstore backend, that's my bet :-)

Cheers

On 27/01/2015 22:03, Gregory Farnum wrote:
> Nifty; it's good to have that sort of blog-style documentation about
> the interface. Are you planning to do some work with it that you can
> show off as well? :)
> -Greg
> 
> On Tue, Jan 27, 2015 at 12:48 PM, Marcel Lauhoff <ml@irq0.org> wrote:
>>
>> Hi,
>>
>> I wrote an article about the object store API - How it works and looks
>> like with a focus on how to add something new.
>>
>> http://irq0.org/articles/ceph/objectstore
>>
>> Maybe its useful for somebody.. Feedback is greatly appreciated!
>>
>>
>>
>> [ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
>> and will probably write something more about other parts of Ceph
>> crossing my way in the near future :) ]
>>
>>
>> ~marcel
>>
>>
>> --
>> Marcel Lauhoff
>> Mail/XMPP: ml@irq0.org
>> http://irq0.org
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]

Re: Article about Object Store API

[Marcel Lauhoff]

Hi,
thanks!


Well, maybe, but probably not :) I'm at this point going through a list of
cold storage system ideas for my thesis. Part of that is evaluating how
one /could/ implement them in Ceph. A special object store that accesses
an archive system is one of them. I'll later plan to implement something, but I
haven't yet decided on what ;)

~marcel

Loic Dachary <loic@dachary.org> writes:

> Hi Marcel,
>
> I'll bookmark this: useful high level view to get oriented when going back to this part of the code. I have the same question as Greg actually. It looks like you're tempted to try a new objectstore backend, that's my bet :-)
>
> Cheers
>
> On 27/01/2015 22:03, Gregory Farnum wrote:
>> Nifty; it's good to have that sort of blog-style documentation about
>> the interface. Are you planning to do some work with it that you can
>> show off as well? :)
>> -Greg
>>
>> On Tue, Jan 27, 2015 at 12:48 PM, Marcel Lauhoff <ml@irq0.org> wrote:
>>>
>>> Hi,
>>>
>>> I wrote an article about the object store API - How it works and looks
>>> like with a focus on how to add something new.
>>>
>>> http://irq0.org/articles/ceph/objectstore
>>>
>>> Maybe its useful for somebody.. Feedback is greatly appreciated!
>>>
>>>
>>>
>>> [ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
>>> and will probably write something more about other parts of Ceph
>>> crossing my way in the near future :) ]
>>>
>>>
>>> ~marcel

Re: Article about Object Store API

[Dan Mick]

Very cool.  Thank you!

On 01/27/2015 12:48 PM, Marcel Lauhoff wrote:
> 
> Hi,
> 
> I wrote an article about the object store API - How it works and looks
> like with a focus on how to add something new.
> 
> http://irq0.org/articles/ceph/objectstore
> 
> Maybe its useful for somebody.. Feedback is greatly appreciated!
> 
> 
> 
> [ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
> and will probably write something more about other parts of Ceph
> crossing my way in the near future :) ]
> 
> 
> ~marcel
> 
> 
> --
> Marcel Lauhoff
> Mail/XMPP: ml@irq0.org
> http://irq0.org
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

-- 
Dan Mick
Red Hat, Inc.
Ceph docs: http://ceph.com/docs

Re: Article about Object Store API

[Dennis Chen]

Hello marcel,

Very good article though I am still reading it. Do you have a clear
picture of the relationship between class and
librados API - rados_exec()?

On Wed, Jan 28, 2015 at 4:48 AM, Marcel Lauhoff <ml@irq0.org> wrote:
>
> Hi,
>
> I wrote an article about the object store API - How it works and looks
> like with a focus on how to add something new.
>
> http://irq0.org/articles/ceph/objectstore
>
> Maybe its useful for somebody.. Feedback is greatly appreciated!
>
>
>
> [ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
> and will probably write something more about other parts of Ceph
> crossing my way in the near future :) ]
>
>
> ~marcel
>
>
> --
> Marcel Lauhoff
> Mail/XMPP: ml@irq0.org
> http://irq0.org
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html



-- 
Den

Re: Article about Object Store API

[Marcel Lauhoff]

Hello Dennis,

I haven't dived into librados code yet, but as far as I can see it is a
couple of layers above what I wrote about. :/

Can you please concretize your question a bit?

~marcel

Dennis Chen <kernel.org.gnu@gmail.com> writes:

> Hello marcel,
>
> Very good article though I am still reading it. Do you have a clear
> picture of the relationship between class and
> librados API - rados_exec()?
>
> On Wed, Jan 28, 2015 at 4:48 AM, Marcel Lauhoff <ml@irq0.org> wrote:
>>
>> Hi,
>>
>> I wrote an article about the object store API - How it works and looks
>> like with a focus on how to add something new.
>>
>> http://irq0.org/articles/ceph/objectstore
>>
>> Maybe its useful for somebody.. Feedback is greatly appreciated!
>>
>>
>>
>> [ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
>> and will probably write something more about other parts of Ceph
>> crossing my way in the near future :) ]
>>
>>
>> ~marcel
>>
>>
>> --
>> Marcel Lauhoff
>> Mail/XMPP: ml@irq0.org
>> http://irq0.org
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html

--
Marcel Lauhoff
Mail/XMPP: ml@irq0.org
http://irq0.org etq

Re: Article about Object Store API

[Dennis Chen]

Hello, marcel,

Below is the email sent to the ceph-users mail list regarding ceph
class question, but seems it's in pending state since I am not the
member of that list.
>>
Hello,

I found the document of ceph class usage is very few, below is the
only one which can almost address my needs--
http://ceph.com/rados/dynamic-object-interfaces-with-lua/

But still some questions confusing me left there:

1. How to make the OSD to load the class lib? or what's the process
for an OSD deamon to load a customized class lib?
I checked my OSD log file(/var/log/ceph/ceph-osd.2.
log), I can't find
the log message "loading cls_hello", does that mean the "hello" class
lib hasn't been loaded by the osd deamon yet? But I can see the
'libcls_hello.so' is really under /usr/lib64/rados-classes folder of
that OSD.

2. Suppose I have an object named "testobj" stored into OSD0 and OSD1,
what will happen if I call the rados_exec(..., "testobj", "hello",
"say_hello",...) in client side? Will the say_hello() function be
called twice in OSD0 and OSD1 respectively?

On Thu, Jan 29, 2015 at 4:14 PM, Dennis Chen <kernel.org.gnu@gmail.com> wrote:
> Hello marcel,
>
> Very good article though I am still reading it. Do you have a clear
> picture of the relationship between class and
> librados API - rados_exec()?
>
> On Wed, Jan 28, 2015 at 4:48 AM, Marcel Lauhoff <ml@irq0.org> wrote:
>>
>> Hi,
>>
>> I wrote an article about the object store API - How it works and looks
>> like with a focus on how to add something new.
>>
>> http://irq0.org/articles/ceph/objectstore
>>
>> Maybe its useful for somebody.. Feedback is greatly appreciated!
>>
>>
>>
>> [ I'm working on a Master's Thesis about Cold Storage / Archives using Ceph
>> and will probably write something more about other parts of Ceph
>> crossing my way in the near future :) ]
>>
>>
>> ~marcel
>>
>>
>> --
>> Marcel Lauhoff
>> Mail/XMPP: ml@irq0.org
>> http://irq0.org
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
>
>
> --
> Den



-- 
Den