From: Stefan Priebe - Profihost AG <s.priebe@profihost.ag>
To: Mark Nelson <mark.nelson@inktank.com>
Cc: "Alexandre DERUMIER" <aderumier@odiso.com>,
ceph-devel <ceph-devel@vger.kernel.org>,
"Mark Kampe" <mark.kampe@inktank.com>,
"Sébastien Han" <han.sebastien@gmail.com>
Subject: Re: RBD fio Performance concerns
Date: Fri, 23 Nov 2012 14:43:33 +0100 [thread overview]
Message-ID: <50AF7D85.2050801@profihost.ag> (raw)
In-Reply-To: <50AF7B3F.3050609@profihost.ag>
*arg* don't do bandwith limit tests to 10Mbit/s in parallel...
Am 23.11.2012 14:33, schrieb Stefan Priebe - Profihost AG:
> Am 23.11.2012 14:24, schrieb Stefan Priebe - Profihost AG:
>> Am 23.11.2012 14:18, schrieb Mark Nelson:
>>> Agreed with Alexandre, try putting the journal on a raw partition.
>>> That's pretty insane! What controller are you using again?
>
> uhu crazy now i have the same with tmpfs... no idea what's going on here.
>
> I've updated ceph to latest git next. Maybe i should rollback.
>
> Stefan
>
>>
>> Makes no difference. No Controller. Just using the SATA 3.0 onboard
>> Ports for each SSD.
>>
>> fio directly on SSD gives me 45.000 rand 4k write iops and 270Mb/s seq
>> write speed. So that's ok.
>>
>> Stefan
>>
>>> Mark
>>>
>>> On 11/23/2012 05:03 AM, Alexandre DERUMIER wrote:
>>>> so correcly aligned...
>>>>
>>>> Maybe try to use journal directly on the full partition, without xfs ?
>>>>
>>>>
>>>> ----- Mail original -----
>>>>
>>>> De: "Stefan Priebe - Profihost AG" <s.priebe@profihost.ag>
>>>> À: "Alexandre DERUMIER" <aderumier@odiso.com>
>>>> Cc: "Mark Nelson" <mark.nelson@inktank.com>, "ceph-devel"
>>>> <ceph-devel@vger.kernel.org>, "Mark Kampe" <mark.kampe@inktank.com>,
>>>> "Sébastien Han" <han.sebastien@gmail.com>
>>>> Envoyé: Vendredi 23 Novembre 2012 11:49:10
>>>> Objet: Re: RBD fio Performance concerns
>>>>
>>>> Am 23.11.2012 11:47, schrieb Alexandre DERUMIER:
>>>>>>> when i switch the journal to the OSD Disk seperate partiton on each
>>>>>>> disk
>>>>>>> (/dev/sdX1 for journal 1GB and /dev/sdX2 for OSD) i go down from
>>>>>>> 23.000
>>>>>>> iops to 200 iops random 4k.
>>>>> O_o , that's seem crazy...
>>>>> Are you sure that your partitions are correctly aligned ? (starting
>>>>> first partition at sector 2048 is best for ssd)
>>>>
>>>> Model: ATA INTEL SSDSC2CW24 (scsi)
>>>> Disk /dev/sdb: 468862128s
>>>> Sector size (logical/physical): 512B/512B
>>>> Partition Table: gpt
>>>>
>>>> Number Start End Size File system Name Flags
>>>> 1 2048s 2342911s 2340864s xfs pri
>>>> 2 2342912s 468860927s 466518016s xfs pri
>>>>
>>>> Stefan
>>>>
>>>
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
next prev parent reply other threads:[~2012-11-23 13:43 UTC|newest]
Thread overview: 51+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <50A537EA.5090409@inktank.com>
[not found] ` <CAOLwVUmQa4C_vs_Mbi3b2LeO=wx8_EMVWX5Pyu0y-JnG8nyz+Q@mail.gmail.com>
2012-11-16 22:59 ` RBD fio Performance concerns Mark Kampe
2012-11-19 14:56 ` Sébastien Han
2012-11-19 15:28 ` Alexandre DERUMIER
2012-11-19 15:42 ` Sébastien Han
2012-11-19 16:44 ` Sage Weil
2012-11-19 16:54 ` Mark Kampe
2012-11-19 18:03 ` Sébastien Han
2012-11-19 19:11 ` Alexandre DERUMIER
2012-11-19 20:57 ` Sébastien Han
2012-11-20 7:32 ` Alexandre DERUMIER
2012-11-20 10:37 ` Sébastien Han
2012-11-21 15:52 ` Mark Nelson
2012-11-21 16:34 ` Mark Nelson
2012-11-21 21:47 ` Sébastien Han
2012-11-21 22:05 ` Mark Kampe
2012-11-22 5:46 ` Alexandre DERUMIER
2012-11-23 13:36 ` Chen, Xiaoxi
2012-11-24 16:59 ` Gregory Farnum
2012-11-22 10:19 ` Stefan Priebe - Profihost AG
[not found] ` <CAOLwVUmp7wrfead8qX2BZPbyeN_JY_XBN+wkEWmbY6q1-5u0fw@mail.gmail.com>
2012-11-22 11:48 ` Stefan Priebe - Profihost AG
2012-11-22 12:50 ` Sébastien Han
2012-11-22 13:14 ` Stefan Priebe - Profihost AG
[not found] ` <CAOLwVUkwVSv-Ven2CTjnTN2J573TBTD2SLDY7df0h7ncJZQgpQ@mail.gmail.com>
2012-11-22 13:29 ` Stefan Priebe - Profihost AG
2012-11-22 14:20 ` Alexandre DERUMIER
2012-11-22 14:22 ` Stefan Priebe - Profihost AG
2012-11-22 14:37 ` Mark Nelson
2012-11-22 14:42 ` Stefan Priebe - Profihost AG
2012-11-22 14:46 ` Mark Nelson
2012-11-22 15:01 ` Stefan Priebe - Profihost AG
2012-11-22 15:26 ` Alexandre DERUMIER
2012-11-22 15:28 ` Stefan Priebe - Profihost AG
2012-11-22 15:35 ` Alexandre DERUMIER
2012-11-22 15:49 ` Sébastien Han
2012-11-22 15:54 ` Stefan Priebe - Profihost AG
2012-11-22 15:55 ` Sébastien Han
2012-11-22 15:57 ` Stefan Priebe - Profihost AG
2012-11-22 15:59 ` Stefan Priebe - Profihost AG
2012-11-22 14:52 ` Alexandre DERUMIER
2012-11-22 15:00 ` Stefan Priebe - Profihost AG
2012-11-23 10:31 ` Stefan Priebe - Profihost AG
2012-11-23 10:47 ` Alexandre DERUMIER
2012-11-23 10:49 ` Stefan Priebe - Profihost AG
2012-11-23 11:03 ` Alexandre DERUMIER
2012-11-23 13:12 ` Stefan Priebe - Profihost AG
2012-11-23 13:18 ` Mark Nelson
2012-11-23 13:24 ` Stefan Priebe - Profihost AG
2012-11-23 13:32 ` Alexandre DERUMIER
2012-11-23 13:33 ` Stefan Priebe - Profihost AG
2012-11-23 13:43 ` Stefan Priebe - Profihost AG [this message]
2012-11-22 14:34 ` Mark Nelson
[not found] ` <50AA763A.1050709@inktank.com>
2012-11-19 21:01 ` Sébastien Han
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=50AF7D85.2050801@profihost.ag \
--to=s.priebe@profihost.ag \
--cc=aderumier@odiso.com \
--cc=ceph-devel@vger.kernel.org \
--cc=han.sebastien@gmail.com \
--cc=mark.kampe@inktank.com \
--cc=mark.nelson@inktank.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox