All of lore.kernel.org
 help / color / mirror / Atom feed
From: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
To: ceph-devel@vger.kernel.org
Subject: Increasing number of PGs
Date: Sat, 28 Jul 2012 19:29:03 +0930	[thread overview]
Message-ID: <5013B7E7.3020407@bashkirtsev.com> (raw)

Hello,

I am working on optimization of ceph performance: CPU load vs OSD data 
load. Right now I have 576 PGs in total. Three pools: metadata, data, 
rbd. Each pool has 192 PGs. data is not used heavily, rbd is in heavy 
use. In total 6 OSDs in cluster. I have read recommendation about 100 
PGs per OSD. Roughly I do have 100 PGs per OSD. But now it seems that 
PGs in data pool are mostly empty while PGs in rbd pool are quite busy. 
Would it make sense to increase number of PGs to be 100 per rbd pool per 
OSD? Technically it should take some memory and CPU but because other 
two pools are virtually stand still it should not make big difference 
while improving data placement on OSDs (which is currently somewhat skewed).

So here two questions:

1. Should I increase number of PGs in rbd pool or better leave it where 
it is?
2. Wiki says that increase in PGs is not tested and only should be 
attempted on empty pool. Date on Wiki is quite old. Is this still an 
issue? Is it safe to increase PGs number on 0.49 on pool in use?

Regards,
Vladimir

             reply	other threads:[~2012-07-28  9:59 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-07-28  9:59 Vladimir Bashkirtsev [this message]
2012-07-30 16:16 ` Increasing number of PGs Josh Durgin
2012-07-30 17:45   ` Vladimir Bashkirtsev
  -- strict thread matches above, loose matches on Subject: below --
2012-07-28  9:53 Vladimir Bashkirtsev

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5013B7E7.3020407@bashkirtsev.com \
    --to=vladimir@bashkirtsev.com \
    --cc=ceph-devel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.