ceph and network

ceph and network

[Fyodor Ustinov]

Hi!

I need to implement this scheme of servers connections:

All servers of ceph cluster have 2 network addresses in different nets.
One net - for ceph interconnect. I.e. for traffic between ceph servers 
(Suppose called "internal").
One - for traffic between clients and cluster ("external").

As I understand it - the client receives the address of the ceph servers 
frommon. And mon server needs to know about that it is necessary give 
out "external" address, not "internal".

How can I do?

WBR,
    Fyodor.

Re: ceph and network

[Brian Chrisman]

On Tue, May 24, 2011 at 3:05 AM, Fyodor Ustinov <ufm@ufm.su> wrote:
> Hi!
>
> I need to implement this scheme of servers connections:
>
> All servers of ceph cluster have 2 network addresses in different nets.
> One net - for ceph interconnect. I.e. for traffic between ceph servers
> (Suppose called "internal").
> One - for traffic between clients and cluster ("external").
>
> As I understand it - the client receives the address of the ceph servers
> frommon. And mon server needs to know about that it is necessary give out
> "external" address, not "internal".
>
> How can I do?

There's a 'cluster addr' option which is intended to split the traffic
between multiple networks afaik.


>
> WBR,
>   Fyodor.
>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: ceph and network

[Fyodor Ustinov]

On 05/24/2011 05:55 PM, Brian Chrisman wrote:
> On Tue, May 24, 2011 at 3:05 AM, Fyodor Ustinov<ufm@ufm.su>  wrote:
>> Hi!
>>
>> I need to implement this scheme of servers connections:
>>
>> All servers of ceph cluster have 2 network addresses in different nets.
>> One net - for ceph interconnect. I.e. for traffic between ceph servers
>> (Suppose called "internal").
>> One - for traffic between clients and cluster ("external").
>>
>> As I understand it - the client receives the address of the ceph servers
>> frommon. And mon server needs to know about that it is necessary give out
>> "external" address, not "internal".
>>
>> How can I do?
> There's a 'cluster addr' option which is intended to split the traffic
> between multiple networks afaik.
As Iunderstandmdsandmonserversshould livein the"public"network?

WBR,
     Fyodor.

Re: ceph and network

[Sage Weil]

On Wed, 25 May 2011, Fyodor Ustinov wrote:
> On 05/24/2011 05:55 PM, Brian Chrisman wrote:
> > On Tue, May 24, 2011 at 3:05 AM, Fyodor Ustinov<ufm@ufm.su>  wrote:
> > > Hi!
> > > 
> > > I need to implement this scheme of servers connections:
> > > 
> > > All servers of ceph cluster have 2 network addresses in different nets.
> > > One net - for ceph interconnect. I.e. for traffic between ceph servers
> > > (Suppose called "internal").
> > > One - for traffic between clients and cluster ("external").
> > > 
> > > As I understand it - the client receives the address of the ceph servers
> > > frommon. And mon server needs to know about that it is necessary give out
> > > "external" address, not "internal".
> > > 
> > > How can I do?
> > There's a 'cluster addr' option which is intended to split the traffic
> > between multiple networks afaik.
> As Iunderstandmdsandmonserversshould livein the"public"network?

They only use the public address, if thats what you mean.  THat doesn't 
mean it has to be a public network (and it probably shouldn't be!).  It 
just means that's the address that other daemons connect to.  In contrast, 
the osd cluster addr is used only for osd to osd communication.

sage