All of lore.kernel.org
 help / color / mirror / Atom feed
* .rgw expand number of pg's
@ 2012-01-10 16:17 Sławomir Skowron
  2012-01-10 17:10 ` Samuel Just
                   ` (2 more replies)
  0 siblings, 3 replies; 5+ messages in thread
From: Sławomir Skowron @ 2012-01-10 16:17 UTC (permalink / raw)
  To: ceph-devel

How to expand number of pg's in rgw pool ??

-- 
-----
Pozdrawiam

Sławek "sZiBis" Skowron
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: .rgw expand number of pg's
  2012-01-10 16:17 .rgw expand number of pg's Sławomir Skowron
@ 2012-01-10 17:10 ` Samuel Just
  2012-01-10 17:10 ` Samuel Just
       [not found] ` <6752061.143.1326216212374.JavaMail.mobile-sync@vbkn16>
  2 siblings, 0 replies; 5+ messages in thread
From: Samuel Just @ 2012-01-10 17:10 UTC (permalink / raw)
  To: Sławomir Skowron; +Cc: ceph-devel

At the moment, expanding the number of pgs in a pool is not working.
We hope to get it working in the somewhat near future (probably a few
months).  Are you attempting to expand the number of osds and running
out of pgs?
-Sam

2012/1/10 Sławomir Skowron <slawomir.skowron@gmail.com>:
> How to expand number of pg's in rgw pool ??
>
> --
> -----
> Pozdrawiam
>
> Sławek "sZiBis" Skowron
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: .rgw expand number of pg's
  2012-01-10 16:17 .rgw expand number of pg's Sławomir Skowron
  2012-01-10 17:10 ` Samuel Just
@ 2012-01-10 17:10 ` Samuel Just
       [not found] ` <6752061.143.1326216212374.JavaMail.mobile-sync@vbkn16>
  2 siblings, 0 replies; 5+ messages in thread
From: Samuel Just @ 2012-01-10 17:10 UTC (permalink / raw)
  To: Sławomir Skowron; +Cc: ceph-devel

At the moment, expanding the number of pgs in a pool is not working.
We hope to get it working in the somewhat near future (probably a few
months).  Are you attempting to expand the number of osds and running
out of pgs?
-Sam

2012/1/10 Sławomir Skowron <slawomir.skowron@gmail.com>:
> How to expand number of pg's in rgw pool ??
>
> --
> -----
> Pozdrawiam
>
> Sławek "sZiBis" Skowron
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: .rgw expand number of pg's
       [not found] ` <6752061.143.1326216212374.JavaMail.mobile-sync@vbkn16>
@ 2012-01-10 21:27   ` Sławomir Skowron
  2012-01-10 22:00     ` Samuel Just
  0 siblings, 1 reply; 5+ messages in thread
From: Sławomir Skowron @ 2012-01-10 21:27 UTC (permalink / raw)
  To: Samuel Just; +Cc: ceph-devel@vger.kernel.org

Maybe i missunderstood problem, but i see something like this.

My setup is 3 node cluster. 78 osd and 3 mons. At the top of the
cluster working radosgw on every machine. Every pool have a 3
replicas. Default politics for replicas is host in racks, and every
machine is in other rack.

When i do a stress test via s3 client, writing a lot of new object via
balancer to the cluster i discovered, that only 3 osd are involved.
This means that only one osd on every machine working in one time,
when the object are writen via radosgw.

Thats why i write this mail about increase number of pgs in radosgw
pool. Maybe i am wrong, but how i can perform this better, more
parallel, to use power of many drives (osd's) ??

For example when i use a rbd in this case, usage of osd devices is
more random, and parallel.

Pozdrawiam

iSS

On 10 sty 2012, at 18:11, Samuel Just <sam.just@dreamhost.com> wrote:

> At the moment, expanding the number of pgs in a pool is not working.
> We hope to get it working in the somewhat near future (probably a few
> months).  Are you attempting to expand the number of osds and running
> out of pgs?
> -Sam
>
> 2012/1/10 Sławomir Skowron <slawomir.skowron@gmail.com>:
>> How to expand number of pg's in rgw pool ??
>>
>> --
>> -----
>> Pozdrawiam
>>
>> Sławek "sZiBis" Skowron
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: .rgw expand number of pg's
  2012-01-10 21:27   ` Sławomir Skowron
@ 2012-01-10 22:00     ` Samuel Just
  0 siblings, 0 replies; 5+ messages in thread
From: Samuel Just @ 2012-01-10 22:00 UTC (permalink / raw)
  To: Sławomir Skowron; +Cc: ceph-devel@vger.kernel.org

Could you post your ceph.conf to the list?  The output of 'ceph -s'
and 'ceph pg dump' would also help.
-Sam

2012/1/10 Sławomir Skowron <szibis@gmail.com>:
> Maybe i missunderstood problem, but i see something like this.
>
> My setup is 3 node cluster. 78 osd and 3 mons. At the top of the
> cluster working radosgw on every machine. Every pool have a 3
> replicas. Default politics for replicas is host in racks, and every
> machine is in other rack.
>
> When i do a stress test via s3 client, writing a lot of new object via
> balancer to the cluster i discovered, that only 3 osd are involved.
> This means that only one osd on every machine working in one time,
> when the object are writen via radosgw.
>
> Thats why i write this mail about increase number of pgs in radosgw
> pool. Maybe i am wrong, but how i can perform this better, more
> parallel, to use power of many drives (osd's) ??
>
> For example when i use a rbd in this case, usage of osd devices is
> more random, and parallel.
>
> Pozdrawiam
>
> iSS
>
> On 10 sty 2012, at 18:11, Samuel Just <sam.just@dreamhost.com> wrote:
>
>> At the moment, expanding the number of pgs in a pool is not working.
>> We hope to get it working in the somewhat near future (probably a few
>> months).  Are you attempting to expand the number of osds and running
>> out of pgs?
>> -Sam
>>
>> 2012/1/10 Sławomir Skowron <slawomir.skowron@gmail.com>:
>>> How to expand number of pg's in rgw pool ??
>>>
>>> --
>>> -----
>>> Pozdrawiam
>>>
>>> Sławek "sZiBis" Skowron
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2012-01-10 22:00 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2012-01-10 16:17 .rgw expand number of pg's Sławomir Skowron
2012-01-10 17:10 ` Samuel Just
2012-01-10 17:10 ` Samuel Just
     [not found] ` <6752061.143.1326216212374.JavaMail.mobile-sync@vbkn16>
2012-01-10 21:27   ` Sławomir Skowron
2012-01-10 22:00     ` Samuel Just

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.