From: Josh Durgin <josh.durgin@inktank.com>
To: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
Cc: ceph-devel@vger.kernel.org
Subject: Re: Increasing number of PGs
Date: Mon, 30 Jul 2012 09:16:10 -0700 [thread overview]
Message-ID: <5016B34A.8090902@inktank.com> (raw)
In-Reply-To: <5013B7E7.3020407@bashkirtsev.com>
On 07/28/2012 02:59 AM, Vladimir Bashkirtsev wrote:
> Hello,
>
> I am working on optimization of ceph performance: CPU load vs OSD data
> load. Right now I have 576 PGs in total. Three pools: metadata, data,
> rbd. Each pool has 192 PGs. data is not used heavily, rbd is in heavy
> use. In total 6 OSDs in cluster. I have read recommendation about 100
> PGs per OSD. Roughly I do have 100 PGs per OSD. But now it seems that
> PGs in data pool are mostly empty while PGs in rbd pool are quite busy.
> Would it make sense to increase number of PGs to be 100 per rbd pool per
> OSD? Technically it should take some memory and CPU but because other
> two pools are virtually stand still it should not make big difference
> while improving data placement on OSDs (which is currently somewhat
> skewed).
If you're not using them, you can delete the data and metadata pools.
You can always recreate them later, or use different pools for cephfs.
> So here two questions:
>
> 1. Should I increase number of PGs in rbd pool or better leave it where
> it is?
It would be better to increase it from a data balancing point of view,
but it's not clear that it would help performance.
> 2. Wiki says that increase in PGs is not tested and only should be
> attempted on empty pool. Date on Wiki is quite old. Is this still an
> issue? Is it safe to increase PGs number on 0.49 on pool in use?
Right now the number of pgs in a pool can't be increased. This should
be possible in a couple months. If you can stop I/O to the current pool,
you can create a new one with more pgs, copy all the data to it, delete
the original and rename the new one.
Josh
> Regards,
> Vladimir
next prev parent reply other threads:[~2012-07-30 16:16 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-07-28 9:59 Increasing number of PGs Vladimir Bashkirtsev
2012-07-30 16:16 ` Josh Durgin [this message]
2012-07-30 17:45 ` Vladimir Bashkirtsev
-- strict thread matches above, loose matches on Subject: below --
2012-07-28 9:53 Vladimir Bashkirtsev
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=5016B34A.8090902@inktank.com \
--to=josh.durgin@inktank.com \
--cc=ceph-devel@vger.kernel.org \
--cc=vladimir@bashkirtsev.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox