From mboxrd@z Thu Jan 1 00:00:00 1970 From: Raghunandhan Subject: Re: [ceph-commit] Ceph Zfs Date: Fri, 26 Oct 2012 12:02:23 +0630 Message-ID: <1e5cd344bedc185dd0cf7a930790bc6a@iihtcloudsolutions.com> References: <441865dbf9e127f0b85193c512878a76@iihtcloudsolutions.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Return-path: Received: from oproxy11-pub.bluehost.com ([173.254.64.10]:59729 "HELO oproxy11-pub.bluehost.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with SMTP id S1750932Ab2JZFcY (ORCPT ); Fri, 26 Oct 2012 01:32:24 -0400 In-Reply-To: Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Sage Weil Cc: ceph-devel@vger.kernel.org Also the open bug which is pending i have tried with it. Ceph-osd starts up with zfs volume after the ceph service is up in sometime the osd's stop working. I have been working around with releases from ceph-0.30 till the latest 0.54 to check with zfs compatibility. Kindly let me know if this can happen in any way it would become a breakthrough in our storage design until btrfs becomes stable. --- Regards, Raghunandhan.G IIHT Cloud Solutions Pvt. Ltd. #15, 4th Floor, 'A' Wing, Sri Lakshmi Complex, St. Marks Road, Bangalore - 560 001, India On 25-10-2012 22:06, Sage Weil wrote: > [moved to ceph-devel] > > On Thu, 25 Oct 2012, Raghunandhan wrote: >> Hi All, >> >> I have been working around ceph quite a long and trying to stitch >> zfs with >> ceph. I was able to do it to certain extent as follows: >> 1. zpool creation >> 2. set dedup >> 3. create a mountable volume of zfs (zfs create) >> 4. format the volume with ext4 and enabling xattr >> 5. mkcephfs on the volume >> >> This actually works and dedup is perfect. But i need to avoid >> multiple layers >> on the storage since the performance is very slow and the kernel >> timeout >> occurs often for a 8GB RAM. I want to test the performance between >> btrfs and >> zfs. I want to avoid the above multiple layering on storage and make >> the ceph >> cluster aware of zfs. Let me know if anyone has workaround this. > > I'm not familiar enough with zfs to know what 'mountable volume' > means.. > is that a block device/lun that you're putting ext4 on? Probably the > best > results will come from creating a zfs *file system* (using the ZPL or > whatever it is) and running ceph-osd on top of that. > > There is at least one open bug from someone having problems there, > but > we'd very much like to sort out the problem. > > sage