From mboxrd@z Thu Jan 1 00:00:00 1970 From: Stefan Priebe - Profihost AG Subject: Re: RBD fio Performance concerns Date: Fri, 23 Nov 2012 14:43:33 +0100 Message-ID: <50AF7D85.2050801@profihost.ag> References: <3ed000f5-38d6-45dd-917e-5e29c5b7ff1a@mailpro> <50AF7798.9060303@inktank.com> <50AF790A.5070806@profihost.ag> <50AF7B3F.3050609@profihost.ag> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE Return-path: Received: from mail.profihost.ag ([85.158.179.208]:58315 "EHLO mail.profihost.ag" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752113Ab2KWNnn (ORCPT ); Fri, 23 Nov 2012 08:43:43 -0500 In-Reply-To: <50AF7B3F.3050609@profihost.ag> Sender: ceph-devel-owner@vger.kernel.org List-ID: To: Mark Nelson Cc: Alexandre DERUMIER , ceph-devel , Mark Kampe , =?UTF-8?B?U8OpYmFzdGllbiBIYW4=?= *arg* don't do bandwith limit tests to 10Mbit/s in parallel... Am 23.11.2012 14:33, schrieb Stefan Priebe - Profihost AG: > Am 23.11.2012 14:24, schrieb Stefan Priebe - Profihost AG: >> Am 23.11.2012 14:18, schrieb Mark Nelson: >>> Agreed with Alexandre, try putting the journal on a raw partition. >>> That's pretty insane! What controller are you using again? > > uhu crazy now i have the same with tmpfs... no idea what's going on h= ere. > > I've updated ceph to latest git next. Maybe i should rollback. > > Stefan > >> >> Makes no difference. No Controller. Just using the SATA 3.0 onboard >> Ports for each SSD. >> >> fio directly on SSD gives me 45.000 rand 4k write iops and 270Mb/s s= eq >> write speed. So that's ok. >> >> Stefan >> >>> Mark >>> >>> On 11/23/2012 05:03 AM, Alexandre DERUMIER wrote: >>>> so correcly aligned... >>>> >>>> Maybe try to use journal directly on the full partition, without x= fs ? >>>> >>>> >>>> ----- Mail original ----- >>>> >>>> De: "Stefan Priebe - Profihost AG" >>>> =C3=80: "Alexandre DERUMIER" >>>> Cc: "Mark Nelson" , "ceph-devel" >>>> , "Mark Kampe" , >>>> "S=C3=A9bastien Han" >>>> Envoy=C3=A9: Vendredi 23 Novembre 2012 11:49:10 >>>> Objet: Re: RBD fio Performance concerns >>>> >>>> Am 23.11.2012 11:47, schrieb Alexandre DERUMIER: >>>>>>> when i switch the journal to the OSD Disk seperate partiton on = each >>>>>>> disk >>>>>>> (/dev/sdX1 for journal 1GB and /dev/sdX2 for OSD) i go down fro= m >>>>>>> 23.000 >>>>>>> iops to 200 iops random 4k. >>>>> O_o , that's seem crazy... >>>>> Are you sure that your partitions are correctly aligned ? (starti= ng >>>>> first partition at sector 2048 is best for ssd) >>>> >>>> Model: ATA INTEL SSDSC2CW24 (scsi) >>>> Disk /dev/sdb: 468862128s >>>> Sector size (logical/physical): 512B/512B >>>> Partition Table: gpt >>>> >>>> Number Start End Size File system Name Flags >>>> 1 2048s 2342911s 2340864s xfs pri >>>> 2 2342912s 468860927s 466518016s xfs pri >>>> >>>> Stefan >>>> >>> -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" i= n the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html