From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mike Almateia Subject: Re: Question about big EC pool. Date: Sun, 13 Sep 2015 20:39:18 +0300 Message-ID: <55F5B4C6.1040606@gmail.com> References: <55F44C3D.4070603@gmail.com> <755F6B91B3BE364F9BCA11EA3F9E0C6F2CE44457@SACMBXIP01.sdcorp.global.sandisk.com> <55F4793A.8040802@gmail.com> <755F6B91B3BE364F9BCA11EA3F9E0C6F2CE4473A@SACMBXIP01.sdcorp.global.sandisk.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: Received: from mail-la0-f49.google.com ([209.85.215.49]:36759 "EHLO mail-la0-f49.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752758AbbIMRjW (ORCPT ); Sun, 13 Sep 2015 13:39:22 -0400 Received: by lanb10 with SMTP id b10so74023184lan.3 for ; Sun, 13 Sep 2015 10:39:20 -0700 (PDT) In-Reply-To: <755F6B91B3BE364F9BCA11EA3F9E0C6F2CE4473A@SACMBXIP01.sdcorp.global.sandisk.com> Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Somnath Roy , ceph-devel 13-Sep-15 01:12, Somnath Roy =D0=BF=D0=B8=D1=88=D0=B5=D1=82: > 12-Sep-15 19:34, Somnath Roy =D0=BF=D0=B8=D1=88=D0=B5=D1=82: >> >I don't think there is any limit from Ceph side.. >> >We are testing with ~768 TB deployment with 4:2 EC on Flash and it = is working well so far.. >> > >> >Thanks & Regards >> >Somnath > Thanks for answer! > > It's very interesting! > > What is hardware you use for your the test cluster? > [Somnath] Three 256 TB SanDisk's JBOF (IF100) and 2 heads in front of= that , so, total of 6 node cluster. FYI, each IF100 can support max 51= 2 TB. Heads are with 128GB RAM and Xeon 2690 V3 dual socket on each of= the server. What a version of ceph you use? How cluster working in degraded state? Performance degradation is huge? I think that e5-2690 didn't enough for that flash cluster. How you have 6 node if as you say "Three 256 TB SanDisk's JBOF (IF100)=20 and 2 heads in front of that", may be I not realized how IF100 working. > You use only SSD or SSD+NVE? > > [Somnath] For now, it is all SSDs. > > Journal is located on the same SSD or not? > > [Somnath] Yes, journal is on the same SSD. > > What a plugin you use? > > [Somnath] Cauchy_good jerasure. You did try the isa plugin? > > You catch some bugs or strange things? > > [Somnath] So far all is well :-) > It's good :) Thanks for answer! --=20 Mike, yes. -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" i= n the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html