From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Matt W. Benjamin" Subject: Re: loadable objectstore Date: Mon, 22 Jun 2015 11:07:01 -0400 (EDT) Message-ID: <46879752.37.1434985621131.JavaMail.root@thunderbeast.private.linuxbox.com> References: <1615100301.29.1434984131967.JavaMail.root@thunderbeast.private.linuxbox.com> Reply-To: "Matt W. Benjamin" Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: Received: from aa.linuxbox.com ([69.128.83.226]:3589 "EHLO aa.linuxbox.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751668AbbFVPPy convert rfc822-to-8bit (ORCPT ); Mon, 22 Jun 2015 11:15:54 -0400 In-Reply-To: <1615100301.29.1434984131967.JavaMail.root@thunderbeast.private.linuxbox.com> Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Varada Kari Cc: Loic Dachary , ceph-devel , Sage Weil Hi, It's just aesthetic, but it feels clunky to change the names of well known modules to Plugin--esp. if that generalizes fo= rward to new loadable modules (and we have a lot of loadable interfaces). Matt ----- "Varada Kari" wrote: > Hi Sage, >=20 > Please find the initial implementation of objects store factory > (initial cut) at > https://github.com/varadakari/ceph/commit/9d5fe2fecf38ba106c7c7b7a3ed= e4f189ec7e1c8 > =20 > This is still work in progress branch. Right now I am facing Lttng > issues,=20 > LTTng-UST: Error (-17) while registering tracepoint probe. Duplicate > registration of tracepoint probes having the same name is not > allowed. >=20 > Might be an issue with libcommon inclusion. Trying resolving the issu= e > now. Seems I need to make libcommon also as a shared object to avoid > the duplicates, static linking is a problem here. > Any suggestions or comments on this problem? >=20 >=20 > I have commented out test binary (ceph_test_keyvaluedb_atomicity) > compilation, due to unresolved symbols for g_ceph_context and g_conf. > Not able to fix/workaround the problem so far. >=20 > Can you please review if this is what in your mind for the factory > implementation?=20 >=20 > We can extend this implementation to messenger and different backend > of the OSD. Will make those incremental once the base framework is > approved.=20 >=20 > Thanks, > Varada >=20 >=20 >=20 > -----Original Message----- > From: Sage Weil [mailto:sage@newdream.net]=20 > Sent: Tuesday, May 12, 2015 5:11 AM > To: Varada Kari > Cc: Loic Dachary; Matt W. Benjamin; ceph-devel > Subject: RE: loadable objectstore >=20 > Hi Varada, >=20 > Any progress on this? >=20 > Thanks! > sage >=20 > On Sat, 11 Apr 2015, Varada Kari wrote: >=20 > > Thanks Sage and Loic. Will add the missing pieces and integrate the > object factory and plugin changes.=20 > >=20 > > Varada > >=20 > > -----Original Message----- > > From: Sage Weil [mailto:sage@newdream.net] > > Sent: Saturday, April 11, 2015 9:19 PM > > To: Loic Dachary > > Cc: Varada Kari; Matt W. Benjamin; ceph-devel > > Subject: Re: loadable objectstore > >=20 > > On Sat, 11 Apr 2015, Loic Dachary wrote: > > > Hi Sage, > > >=20 > > > It looks like common/PluginRegistry.{h,cc} are missing from=20 > > > 18ad8df1094db52c839dc6b2dc689fc882230acb > >=20 > > whoops pushed! :) > >=20 > > sage > >=20 > > >=20 > > > Cheers > > >=20 > > > On 11/04/2015 16:51, Sage Weil wrote: > > > > On Sat, 11 Apr 2015, Varada Kari wrote: > > > >> Hi Matt/ Sage, > > > >> > > > >> Thanks for sharing the pull request. Will work on the items > what=20 > > > >> sage was mentioning in the comments along with the items in th= e > tracker. > > > >=20 > > > > I pushed a wip-plugin branch with the pattern I had in mind...=20 > > > > does this make sense? It's only compile tested, and still > needs > > > > preload() methods implemented so that long-running daemons (or=20 > > > > perhaps others?) can preload it all at once. > > > >=20 > > > > Ideally we would replace ErasurePluginRegistry with this too,=20 > > > > which means the naming of the .so's needs to be a bit more=20 > > > > flexible as the EC plugin scheme is something like=20 > > > > /usr/lib/ceph/erasure-code/libec_$name.so (not a strict functio= n >=20 > > > > of type and name). Or actually, we can just rename the EC .so'= s >=20 > > > > when this goes in? Since they're explicitly incompatible > between=20 > > > > versions there is no reason the names need to remain > consistent... > > > >=20 > > > > sage > > > >=20 > > > >> > > > >> Varada > > > >> > > > >> -----Original Message----- > > > >> From: Sage Weil [mailto:sage@newdream.net] > > > >> Sent: Saturday, April 11, 2015 4:16 AM > > > >> To: Matt W. Benjamin > > > >> Cc: Varada Kari; ceph-devel > > > >> Subject: Re: loadable objectstore > > > >> > > > >> On Fri, 10 Apr 2015, Matt W. Benjamin wrote: > > > >>> Hi Varada, > > > >>> > > > >>> I pushed branch hammer-osfactory to=20 > > > >>> https://github.com/linuxbox2/ceph.git > > > >>> > > > >>> It can at least provide a starting point for discussion, if > not=20 > > > >>> a jumping off point; I do think it's basically what Sage > described. > > > >> > > > >> I made a few comments on the pull request. I think a factory > class is the way to go, but we should be able to make the plugin > loading part generic and not interface specific at all... > > > >> > > > >> sage > > > >> > > > >>> > > > >>> I was able to update the CMake build system to build the tree= , > I=20 > > > >>> haven't attempted Autotools. :( > > > >>> > > > >>> Regards, > > > >>> > > > >>> Matt > > > >>> > > > >>> -- > > > >>> Matt Benjamin > > > >>> CohortFS, LLC. > > > >>> 315 West Huron Street, Suite 140A Ann Arbor, Michigan 48103 > > > >>> > > > >>> http://cohortfs.com > > > >>> > > > >>> tel. 734-761-4689 > > > >>> fax. 734-769-8938 > > > >>> cel. 734-216-5309 > > > >>> -- > > > >>> To unsubscribe from this list: send the line "unsubscribe > ceph-devel" > > > >>> in the body of a message to majordomo@vger.kernel.org More=20 > > > >>> majordomo info at http://vger.kernel.org/majordomo-info.html > > > >>> > > > >>> > > > >> > > > >> ________________________________ > > > >> > > > >> PLEASE NOTE: The information contained in this electronic mail > message is intended only for the use of the designated recipient(s) > named above. If the reader of this message is not the intended > recipient, you are hereby notified that you have received this messag= e > in error and that any review, dissemination, distribution, or copying > of this message is strictly prohibited. If you have received this > communication in error, please notify the sender by telephone or > e-mail (as shown above) immediately and destroy any and all copies of > this message in your possession (whether hard copies or electronicall= y > stored copies). > > > >> > > > >> -- > > > >> To unsubscribe from this list: send the line "unsubscribe=20 > > > >> ceph-devel" in the body of a message to > majordomo@vger.kernel.org=20 > > > >> More majordomo info at =20 > > > >> http://vger.kernel.org/majordomo-info.html > > > >> > > > >> > > > > -- > > > > To unsubscribe from this list: send the line "unsubscribe=20 > > > > ceph-devel" in the body of a message to > majordomo@vger.kernel.org=20 > > > > More majordomo info at=20 > http://vger.kernel.org/majordomo-info.html > > > >=20 > > >=20 > > > -- > > > Lo=C3=AFc Dachary, Artisan Logiciel Libre > > >=20 > > >=20 > > -- > > To unsubscribe from this list: send the line "unsubscribe > ceph-devel"=20 > > in the body of a message to majordomo@vger.kernel.org More majordom= o >=20 > > info at http://vger.kernel.org/majordomo-info.html > >=20 > > --=20 Matt Benjamin CohortFS, LLC. 315 West Huron Street, Suite 140A Ann Arbor, Michigan 48103 http://cohortfs.com tel. 734-761-4689=20 fax. 734-769-8938=20 cel. 734-216-5309=20 -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" i= n