CEPH filesystem development
 help / color / mirror / Atom feed
From: Josh Durgin <josh.durgin@inktank.com>
To: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
Cc: ceph-devel@vger.kernel.org
Subject: Re: Increasing number of PGs
Date: Mon, 30 Jul 2012 09:16:10 -0700	[thread overview]
Message-ID: <5016B34A.8090902@inktank.com> (raw)
In-Reply-To: <5013B7E7.3020407@bashkirtsev.com>

On 07/28/2012 02:59 AM, Vladimir Bashkirtsev wrote:
> Hello,
>
> I am working on optimization of ceph performance: CPU load vs OSD data
> load. Right now I have 576 PGs in total. Three pools: metadata, data,
> rbd. Each pool has 192 PGs. data is not used heavily, rbd is in heavy
> use. In total 6 OSDs in cluster. I have read recommendation about 100
> PGs per OSD. Roughly I do have 100 PGs per OSD. But now it seems that
> PGs in data pool are mostly empty while PGs in rbd pool are quite busy.
> Would it make sense to increase number of PGs to be 100 per rbd pool per
> OSD? Technically it should take some memory and CPU but because other
> two pools are virtually stand still it should not make big difference
> while improving data placement on OSDs (which is currently somewhat
> skewed).

If you're not using them, you can delete the data and metadata pools.
You can always recreate them later, or use different pools for cephfs.

> So here two questions:
>
> 1. Should I increase number of PGs in rbd pool or better leave it where
> it is?

It would be better to increase it from a data balancing point of view,
but it's not clear that it would help performance.

> 2. Wiki says that increase in PGs is not tested and only should be
> attempted on empty pool. Date on Wiki is quite old. Is this still an
> issue? Is it safe to increase PGs number on 0.49 on pool in use?

Right now the number of pgs in a pool can't be increased. This should
be possible in a couple months. If you can stop I/O to the current pool,
you can create a new one with more pgs, copy all the data to it, delete
the original and rename the new one.

Josh

> Regards,
> Vladimir


  reply	other threads:[~2012-07-30 16:16 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-07-28  9:59 Increasing number of PGs Vladimir Bashkirtsev
2012-07-30 16:16 ` Josh Durgin [this message]
2012-07-30 17:45   ` Vladimir Bashkirtsev
  -- strict thread matches above, loose matches on Subject: below --
2012-07-28  9:53 Vladimir Bashkirtsev

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5016B34A.8090902@inktank.com \
    --to=josh.durgin@inktank.com \
    --cc=ceph-devel@vger.kernel.org \
    --cc=vladimir@bashkirtsev.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox