From mboxrd@z Thu Jan 1 00:00:00 1970 From: Wido den Hollander Subject: Re: emperor, firefly Date: Fri, 01 Nov 2013 09:54:47 +0100 Message-ID: <52736C57.4080005@42on.com> References: Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Return-path: Received: from websrv.42on.com ([31.25.102.167]:59344 "EHLO websrv.42on.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752151Ab3KAIyu (ORCPT ); Fri, 1 Nov 2013 04:54:50 -0400 In-Reply-To: Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Sage Weil , ceph-devel@vger.kernel.org On 11/01/2013 12:02 AM, Sage Weil wrote: > Just wanted to take a moment to call out some of the great work that went > into emperor or is in progress for firely. From the last CDS, completed > blueprints include: > > - ceph osd zfs (Yan, Zheng). This uses zfs snapshots the same way we use > btrfs snapshots, allowing more efficient journaling. ZFS doesn't have > a 'clone' operation, so this doesn't get all of the efficiency advantages > from btrfs. > I haven't tried this yet, but it's on my todo. Looks really great, thanks! > - radosgw bucket level quota (Yehuda Sadeh). User-level quotas are up > next! > Also a great feature. This protects RGW systems against users filling up a single bucket with millions of objects causing the RGW to become very slow with listing. Amazon S3 has the same problem, the XML response simply becomes to large when you have millions of objects in a bucket. > - teuthology bits (Zack Cerza et al). Lots of the rough edges > in teuthology have been filed down over this past cycle and Loic > continues to organize weekly meetings to improve community usability. > Queuing improvements, and perhaps most exciting is a whole new > reporting framework from Alfredo and Zack that gathers results in a > database and builds a dashboard on top of that. > > - ceph-deploy (Alfredo Deza). Huge steps forward here on packaging > (PyPi!), reliability/robustness (no more pushy), and the usability of > the interface (simplified cluster/monitor creation, etc.). > > In progress blueprints: > > - erasure coding for rados (Loic Dachary, Samuel Just). This is a huge > piece of work but most of the erasure coding math is in place and the > OSD refactoring work is on track for firefly! > > - mds inline data zupport (Li Wang). These patches are pending review > and a few revisions (and testing!) > > - increasing ceph portability (Noah Watkins). Noah, along with Alan > Somers, has been knocking down lots of the build and runtime issues on > *BSD and OS X. Most are sitting in wip-port or have already trickled > into master. > > - cache pool overlay (Sage Weil, Greg Farnum): This work is also > partially completed but on track for firefly. > > - librados/objecter, smarter localized reads: This is pending review but > will make firefly. > > - leveldb osd backend (Hoamai Wang). Last I hear this is in progress! > > These is just the items that were on the Emperor CDS agenda that have made > their way into my field of vision. I'm looking forward to the firefly > summit in a couple weeks! There will be several sessions to cover the > balance of the erasure coding and tiering work in detail (now that we're > in the thick of it and more clearly see the path forward), and naturally > some new blueprints as well. If there are features or improvements you > have in mind, feel free to float them on the list for some pre-discussion > if you're not ready to write up a blueprint just yet. > > sage > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > -- Wido den Hollander 42on B.V. Phone: +31 (0)20 700 9902 Skype: contact42on