improve speed with auth supported=none

improve speed with auth supported=none

[Stefan Priebe - Profihost AG]

Hello list,

i'm still trying to improve ceph speed. Disable logging on host and rbd 
client gives me additional 5000 iop/s which is great.

But i also wanted to try disabling authentication using:
auth supported=none

How does this work? Do i just have to place this line under global 
section in ceph.conf?

Greets,
Stefan

Re: improve speed with auth supported=none

[Sébastien Han]

I guess you can refer to that link on the list:
http://comments.gmane.org/gmane.comp.file-systems.ceph.devel/9776

btw do you get 5000 iop/s on the rbd kernel or on a vm disk?

cheers.


On Mon, Nov 12, 2012 at 4:37 PM, Stefan Priebe - Profihost AG
<s.priebe@profihost.ag> wrote:
> Hello list,
>
> i'm still trying to improve ceph speed. Disable logging on host and rbd
> client gives me additional 5000 iop/s which is great.
>
> But i also wanted to try disabling authentication using:
> auth supported=none
>
> How does this work? Do i just have to place this line under global section
> in ceph.conf?
>
> Greets,
> Stefan
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: improve speed with auth supported=none

[Stefan Priebe]

Thanks,

this gives another burst for iops. I'm now at 23.000 iops ;-) So for 
random 4k iops ceph auth and especially the logging is a lot of overhead.

Greets,
Stefan
Am 12.11.2012 19:26, schrieb Sébastien Han:
> I guess you can refer to that link on the list:
> http://comments.gmane.org/gmane.comp.file-systems.ceph.devel/9776
>
> btw do you get 5000 iop/s on the rbd kernel or on a vm disk?
>
> cheers.
>
>
> On Mon, Nov 12, 2012 at 4:37 PM, Stefan Priebe - Profihost AG
> <s.priebe@profihost.ag> wrote:
>> Hello list,
>>
>> i'm still trying to improve ceph speed. Disable logging on host and rbd
>> client gives me additional 5000 iop/s which is great.
>>
>> But i also wanted to try disabling authentication using:
>> auth supported=none
>>
>> How does this work? Do i just have to place this line under global section
>> in ceph.conf?
>>
>> Greets,
>> Stefan
>> --
>> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: improve speed with auth supported=none

[Josh Durgin]

On 11/12/2012 01:57 PM, Stefan Priebe wrote:
> Thanks,
>
> this gives another burst for iops. I'm now at 23.000 iops ;-) So for
> random 4k iops ceph auth and especially the logging is a lot of overhead.

How much difference did disabling auth make vs only disabling logging?

Josh

> Greets,
> Stefan
> Am 12.11.2012 19:26, schrieb Sébastien Han:
>> I guess you can refer to that link on the list:
>> http://comments.gmane.org/gmane.comp.file-systems.ceph.devel/9776
>>
>> btw do you get 5000 iop/s on the rbd kernel or on a vm disk?
>>
>> cheers.
>>
>>
>> On Mon, Nov 12, 2012 at 4:37 PM, Stefan Priebe - Profihost AG
>> <s.priebe@profihost.ag> wrote:
>>> Hello list,
>>>
>>> i'm still trying to improve ceph speed. Disable logging on host and rbd
>>> client gives me additional 5000 iop/s which is great.
>>>
>>> But i also wanted to try disabling authentication using:
>>> auth supported=none
>>>
>>> How does this work? Do i just have to place this line under global
>>> section
>>> in ceph.conf?
>>>
>>> Greets,
>>> Stefan

--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: improve speed with auth supported=none

[Stefan Priebe]

Am 13.11.2012 08:42, schrieb Josh Durgin:
> On 11/12/2012 01:57 PM, Stefan Priebe wrote:
>> Thanks,
>>
>> this gives another burst for iops. I'm now at 23.000 iops ;-) So for
>> random 4k iops ceph auth and especially the logging is a lot of overhead.
>
> How much difference did disabling auth make vs only disabling logging?

disable debug logging: 3000 iops
disable auth logging: 2000 iops

Is anybody in the ceph team also interested in a call graph of kvm when 
VM is doing random 4k write io?

Greets
Stefan

Re: improve speed with auth supported=none

[Josh Durgin]

On 11/12/2012 11:52 PM, Stefan Priebe wrote:
> Am 13.11.2012 08:42, schrieb Josh Durgin:
>> On 11/12/2012 01:57 PM, Stefan Priebe wrote:
>>> Thanks,
>>>
>>> this gives another burst for iops. I'm now at 23.000 iops ;-) So for
>>> random 4k iops ceph auth and especially the logging is a lot of
>>> overhead.
>>
>> How much difference did disabling auth make vs only disabling logging?
>
> disable debug logging: 3000 iops
> disable auth logging: 2000 iops
>
> Is anybody in the ceph team also interested in a call graph of kvm when
> VM is doing random 4k write io?

I'm interested, although I'm not sure how easy it'll be to find
bottlenecks from it. It's worth a shot.

Re: improve speed with auth supported=none

[Stefan Priebe]

Am 13.11.2012 09:04, schrieb Josh Durgin:
> On 11/12/2012 11:52 PM, Stefan Priebe wrote:
>> Am 13.11.2012 08:42, schrieb Josh Durgin:
>>> On 11/12/2012 01:57 PM, Stefan Priebe wrote:
>>>> Thanks,
>>>>
>>>> this gives another burst for iops. I'm now at 23.000 iops ;-) So for
>>>> random 4k iops ceph auth and especially the logging is a lot of
>>>> overhead.
>>>
>>> How much difference did disabling auth make vs only disabling logging?
>>
>> disable debug logging: 3000 iops
>> disable auth logging: 2000 iops
>>
>> Is anybody in the ceph team also interested in a call graph of kvm when
>> VM is doing random 4k write io?
>
> I'm interested, although I'm not sure how easy it'll be to find
> bottlenecks from it. It's worth a shot.

*arg* kvm process segfaults when i use google perf tools to create / 
record one.

Any software suggestion?

Stefan

Re: improve speed with auth supported=none

[Stefan Priebe - Profihost AG]

Am 14.11.2012 14:24, schrieb Soporte:
> El 13/11/2012 04:52 a.m., Stefan Priebe escribió:
>> Am 13.11.2012 08:42, schrieb Josh Durgin:
>>> On 11/12/2012 01:57 PM, Stefan Priebe wrote:
>>>> Thanks,
>>>>
>>>> this gives another burst for iops. I'm now at 23.000 iops ;-) So for
>>>> random 4k iops ceph auth and especially the logging is a lot of
>>>> overhead.
>>>
>>> How much difference did disabling auth make vs only disabling logging?
>>
>> disable debug logging: 3000 iops
>> disable auth logging: 2000 iops
>>
>> Is anybody in the ceph team also interested in a call graph of kvm
>> when VM is doing random 4k write io?

> Hi.
>
> How disable debug and auth loggin in ceph.conf?

I have right now putted this stuff in all section - this is def. 
overkill but i didn't know where to put which of them:
[global]
         auth cluster required = none
         auth service required = none
         auth supported = none
         auth client required = none

         debug lockdep = 0/0
         debug context = 0/0
         debug crush = 0/0
         debug buffer = 0/0
         debug timer = 0/0
         debug journaler = 0/0
         debug osd = 0/0
         debug optracker = 0/0
         debug objclass = 0/0
         debug filestore = 0/0
         debug journal = 0/0
         debug ms = 0/0
         debug monc = 0/0
         debug tp = 0/0
         debug auth = 0/0
         debug finisher = 0/0
         debug heartbeatmap = 0/0
         debug perfcounter = 0/0
         debug asok = 0/0
         debug throttle = 0/0

[mon]
         debug lockdep = 0/0
         debug context = 0/0
         debug crush = 0/0
         debug buffer = 0/0
         debug timer = 0/0
         debug journaler = 0/0
         debug osd = 0/0
         debug optracker = 0/0
         debug objclass = 0/0
         debug filestore = 0/0
         debug journal = 0/0
         debug ms = 0/0
         debug monc = 0/0
         debug tp = 0/0
         debug auth = 0/0
         debug finisher = 0/0
         debug heartbeatmap = 0/0
         debug perfcounter = 0/0
         debug asok = 0/0
         debug throttle = 0/0

[osd]
         debug lockdep = 0/0
         debug context = 0/0
         debug crush = 0/0
         debug buffer = 0/0
         debug timer = 0/0
         debug journaler = 0/0
         debug osd = 0/0
         debug optracker = 0/0
         debug objclass = 0/0
         debug filestore = 0/0
         debug journal = 0/0
         debug ms = 0/0
         debug monc = 0/0
         debug tp = 0/0
         debug auth = 0/0
         debug finisher = 0/0
         debug heartbeatmap = 0/0
         debug perfcounter = 0/0
         debug asok = 0/0
         debug throttle = 0/0


Stefan
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html