Load Balancing / Merging speed

Load Balancing / Merging speed

[Sadus .]

Hello,
If i want to search for HOWTOs that can enable me to merge the
connection speed of multiple providers (inboud/outbound), what should i
search for?

what i mean by merging is, lets say my connection is shaped at 100K and
the other is also shaped at 100K, i want to be able using the 2 ISPs to
have 200K (in/out),

Does anyone have a HOWTO or Article about that Matter?

Thanks

Re: Load Balancing / Merging speed

[Kenneth Kalmer]

On 5/21/05, Sadus . <sadus@swiftbin.net> wrote:
> Hello,
> If i want to search for HOWTOs that can enable me to merge the
> connection speed of multiple providers (inboud/outbound), what should i
> search for?

The nano howto if I'm not mistaken, and have a look at the eql qdisc
and teql device.

> 
> what i mean by merging is, lets say my connection is shaped at 100K and
> the other is also shaped at 100K, i want to be able using the 2 ISPs to
> have 200K (in/out),
> 
> Does anyone have a HOWTO or Article about that Matter?

I asked a similar question in the list not too long ago. Search the
archives for the subject "Spill over" and have a look. There was some
excellent replies from other members on the topic. I have honestly not
had the chance to properly test the configurations myself, but from my
searching and discussions here it won't be an easy feat to achieve.

Relative load balancing is not that difficult, but to fully maximize
the utilization of each link is another story.

> 
> Thanks
> 

Only a pleasure

> 
> 
> 


-- 

Kenneth Kalmer
kenneth.kalmer@gmail.com
http://opensourcery.blogspot.com

Re: Load Balancing / Merging speed

[Sadus .]

I can't seem to find the archive, i searched untill June 2004?
link aggregation
Basicaly i knew that i could do such a thing using Bonding/Trunking/Link
Aggragation but is there a simpler way using iptables/iproute only and
using only 1 NIC (with 2 different IPs/Subnets)

thanks

On Sun, 2005-05-22 at 00:33 +0200, Kenneth Kalmer wrote:
> On 5/21/05, Sadus . <sadus@swiftbin.net> wrote:
> > Hello,
> > If i want to search for HOWTOs that can enable me to merge the
> > connection speed of multiple providers (inboud/outbound), what should i
> > search for?
> 
> The nano howto if I'm not mistaken, and have a look at the eql qdisc
> and teql device.
> 
> > 
> > what i mean by merging is, lets say my connection is shaped at 100K and
> > the other is also shaped at 100K, i want to be able using the 2 ISPs to
> > have 200K (in/out),
> > 
> > Does anyone have a HOWTO or Article about that Matter?
> 
> I asked a similar question in the list not too long ago. Search the
> archives for the subject "Spill over" and have a look. There was some
> excellent replies from other members on the topic. I have honestly not
> had the chance to properly test the configurations myself, but from my
> searching and discussions here it won't be an easy feat to achieve.
> 
> Relative load balancing is not that difficult, but to fully maximize
> the utilization of each link is another story.
> 
> > 
> > Thanks
> > 
> 
> Only a pleasure
> 
> > 
> > 
> > 
> 
> 

Re: Load Balancing / Merging speed

[Eduardo Fernández]

Hi,

On 5/22/05, Sadus . <sadus@swiftbin.net> wrote:
> I can't seem to find the archive, i searched untill June 2004?
> link aggregation
> Basicaly i knew that i could do such a thing using Bonding/Trunking/Link
> Aggragation but is there a simpler way using iptables/iproute only and
> using only 1 NIC (with 2 different IPs/Subnets)

Bonding? You don't use that to merge two internet lines, that's for
making two NIC's work as if they were only one, thus doubling the
speed. With bonding linux "sees" one device where you had two. You can
only set up bonding between two computers or between a computer and a
switch which supports bonding (it's got different names depending on
the brand).

> thanks
> 
> On Sun, 2005-05-22 at 00:33 +0200, Kenneth Kalmer wrote:
> > On 5/21/05, Sadus . <sadus@swiftbin.net> wrote:
> > > Hello,
> > > If i want to search for HOWTOs that can enable me to merge the
> > > connection speed of multiple providers (inboud/outbound), what should i
> > > search for?
> >
> > The nano howto if I'm not mistaken, and have a look at the eql qdisc
> > and teql device.
> >
> > >
> > > what i mean by merging is, lets say my connection is shaped at 100K and
> > > the other is also shaped at 100K, i want to be able using the 2 ISPs to
> > > have 200K (in/out),
> > >
> > > Does anyone have a HOWTO or Article about that Matter?
> >
> > I asked a similar question in the list not too long ago. Search the
> > archives for the subject "Spill over" and have a look. There was some
> > excellent replies from other members on the topic. I have honestly not
> > had the chance to properly test the configurations myself, but from my
> > searching and discussions here it won't be an easy feat to achieve.
> >
> > Relative load balancing is not that difficult, but to fully maximize
> > the utilization of each link is another story.

Cheers!

Edu

Re: Load Balancing / Merging speed

[Sadus .]

So what I am exactly looking for?

On Sun, 2005-05-22 at 01:00 +0200, Eduardo Fernández wrote:
> Hi,
> 
> On 5/22/05, Sadus . <sadus@swiftbin.net> wrote:
> > I can't seem to find the archive, i searched untill June 2004?
> > link aggregation
> > Basicaly i knew that i could do such a thing using Bonding/Trunking/Link
> > Aggragation but is there a simpler way using iptables/iproute only and
> > using only 1 NIC (with 2 different IPs/Subnets)
> 
> Bonding? You don't use that to merge two internet lines, that's for
> making two NIC's work as if they were only one, thus doubling the
> speed. With bonding linux "sees" one device where you had two. You can
> only set up bonding between two computers or between a computer and a
> switch which supports bonding (it's got different names depending on
> the brand).
> 
> > thanks
> > 
> > On Sun, 2005-05-22 at 00:33 +0200, Kenneth Kalmer wrote:
> > > On 5/21/05, Sadus . <sadus@swiftbin.net> wrote:
> > > > Hello,
> > > > If i want to search for HOWTOs that can enable me to merge the
> > > > connection speed of multiple providers (inboud/outbound), what should i
> > > > search for?
> > >
> > > The nano howto if I'm not mistaken, and have a look at the eql qdisc
> > > and teql device.
> > >
> > > >
> > > > what i mean by merging is, lets say my connection is shaped at 100K and
> > > > the other is also shaped at 100K, i want to be able using the 2 ISPs to
> > > > have 200K (in/out),
> > > >
> > > > Does anyone have a HOWTO or Article about that Matter?
> > >
> > > I asked a similar question in the list not too long ago. Search the
> > > archives for the subject "Spill over" and have a look. There was some
> > > excellent replies from other members on the topic. I have honestly not
> > > had the chance to properly test the configurations myself, but from my
> > > searching and discussions here it won't be an easy feat to achieve.
> > >
> > > Relative load balancing is not that difficult, but to fully maximize
> > > the utilization of each link is another story.
> 
> Cheers!
> 
> Edu

Re: Load Balancing / Merging speed

[Kenneth Kalmer]

On 5/22/05, Eduardo Fernández <efgonzalez@gmail.com> wrote:
> Hi,
> 
> On 5/22/05, Sadus . <sadus@swiftbin.net> wrote:
> > I can't seem to find the archive, i searched untill June 2004?
> > link aggregation
> > Basicaly i knew that i could do such a thing using Bonding/Trunking/Link
> > Aggragation but is there a simpler way using iptables/iproute only and
> > using only 1 NIC (with 2 different IPs/Subnets)
> 
> Bonding? You don't use that to merge two internet lines, that's for
> making two NIC's work as if they were only one, thus doubling the
> speed. With bonding linux "sees" one device where you had two. You can
> only set up bonding between two computers or between a computer and a
> switch which supports bonding (it's got different names depending on
> the brand).

Nope, this is not bonding. What Sadus is looking for is called link
equalization IIRC. It's where you use different links of varying
speeds and tie them up together for use as one connection.
Traditionaly you'd use a round-robin method of sending packets out
over multiple default routes. This is not always ideal, you'd need
some kind of intelligence to spread the load more realistically, and
the Linux EQL driver and TEQL device allows for that to happen. These
two know the speed of each link in the equation, and delivers better
control, albeit not perfect.

Now, Sadus, my apologies. The thread I was referring to was on the
LARTC list. The LARTC list is in any case the better list for these
kinds of questions. iptables cannot perform this task, you need the
iproute2 package, and LARTc is the definitive source for information
and discussions on the topic.

The website is http://lartc.org/ and http://lartc.org/howto. The
thread I was referring to is available at
http://marc.theaimsgroup.com/?l=lartc&m=111429252500344&w=2

Hope this helps, and share your experiences if you don't mind!

> 
> > thanks
> >
> > On Sun, 2005-05-22 at 00:33 +0200, Kenneth Kalmer wrote:
> > > On 5/21/05, Sadus . <sadus@swiftbin.net> wrote:
> > > > Hello,
> > > > If i want to search for HOWTOs that can enable me to merge the
> > > > connection speed of multiple providers (inboud/outbound), what should i
> > > > search for?
> > >
> > > The nano howto if I'm not mistaken, and have a look at the eql qdisc
> > > and teql device.
> > >
> > > >
> > > > what i mean by merging is, lets say my connection is shaped at 100K and
> > > > the other is also shaped at 100K, i want to be able using the 2 ISPs to
> > > > have 200K (in/out),
> > > >
> > > > Does anyone have a HOWTO or Article about that Matter?
> > >
> > > I asked a similar question in the list not too long ago. Search the
> > > archives for the subject "Spill over" and have a look. There was some
> > > excellent replies from other members on the topic. I have honestly not
> > > had the chance to properly test the configurations myself, but from my
> > > searching and discussions here it won't be an easy feat to achieve.
> > >
> > > Relative load balancing is not that difficult, but to fully maximize
> > > the utilization of each link is another story.
> 
> Cheers!
> 
> Edu
> 


-- 

Kenneth Kalmer
kenneth.kalmer@gmail.com
http://opensourcery.blogspot.com

Re: Load Balancing / Merging speed

[Sadus .]

Thank you for your reply. I'm gonna check out the TEQL driver and how it
should be implemented. 
I will share my experiences when i'm done =)

On Sun, 2005-05-22 at 04:02 +0200, Kenneth Kalmer wrote:
> On 5/22/05, Eduardo Fernández <efgonzalez@gmail.com> wrote:
> > Hi,
> > 
> > On 5/22/05, Sadus . <sadus@swiftbin.net> wrote:
> > > I can't seem to find the archive, i searched untill June 2004?
> > > link aggregation
> > > Basicaly i knew that i could do such a thing using Bonding/Trunking/Link
> > > Aggragation but is there a simpler way using iptables/iproute only and
> > > using only 1 NIC (with 2 different IPs/Subnets)
> > 
> > Bonding? You don't use that to merge two internet lines, that's for
> > making two NIC's work as if they were only one, thus doubling the
> > speed. With bonding linux "sees" one device where you had two. You can
> > only set up bonding between two computers or between a computer and a
> > switch which supports bonding (it's got different names depending on
> > the brand).
> 
> Nope, this is not bonding. What Sadus is looking for is called link
> equalization IIRC. It's where you use different links of varying
> speeds and tie them up together for use as one connection.
> Traditionaly you'd use a round-robin method of sending packets out
> over multiple default routes. This is not always ideal, you'd need
> some kind of intelligence to spread the load more realistically, and
> the Linux EQL driver and TEQL device allows for that to happen. These
> two know the speed of each link in the equation, and delivers better
> control, albeit not perfect.
> 
> Now, Sadus, my apologies. The thread I was referring to was on the
> LARTC list. The LARTC list is in any case the better list for these
> kinds of questions. iptables cannot perform this task, you need the
> iproute2 package, and LARTc is the definitive source for information
> and discussions on the topic.
> 
> The website is http://lartc.org/ and http://lartc.org/howto. The
> thread I was referring to is available at
> http://marc.theaimsgroup.com/?l=lartc&m=111429252500344&w=2
> 
> Hope this helps, and share your experiences if you don't mind!
> 
> > 
> > > thanks
> > >
> > > On Sun, 2005-05-22 at 00:33 +0200, Kenneth Kalmer wrote:
> > > > On 5/21/05, Sadus . <sadus@swiftbin.net> wrote:
> > > > > Hello,
> > > > > If i want to search for HOWTOs that can enable me to merge the
> > > > > connection speed of multiple providers (inboud/outbound), what should i
> > > > > search for?
> > > >
> > > > The nano howto if I'm not mistaken, and have a look at the eql qdisc
> > > > and teql device.
> > > >
> > > > >
> > > > > what i mean by merging is, lets say my connection is shaped at 100K and
> > > > > the other is also shaped at 100K, i want to be able using the 2 ISPs to
> > > > > have 200K (in/out),
> > > > >
> > > > > Does anyone have a HOWTO or Article about that Matter?
> > > >
> > > > I asked a similar question in the list not too long ago. Search the
> > > > archives for the subject "Spill over" and have a look. There was some
> > > > excellent replies from other members on the topic. I have honestly not
> > > > had the chance to properly test the configurations myself, but from my
> > > > searching and discussions here it won't be an easy feat to achieve.
> > > >
> > > > Relative load balancing is not that difficult, but to fully maximize
> > > > the utilization of each link is another story.
> > 
> > Cheers!
> > 
> > Edu
> > 
> 
> 

Re: Load Balancing / Merging speed

[Jason Opperisano]

On Sat, May 21, 2005 at 09:55:10AM +0300, Sadus . wrote:
> Hello,
> If i want to search for HOWTOs that can enable me to merge the
> connection speed of multiple providers (inboud/outbound), what should i
> search for?
> 
> what i mean by merging is, lets say my connection is shaped at 100K and
> the other is also shaped at 100K, i want to be able using the 2 ISPs to
> have 200K (in/out),
> 
> Does anyone have a HOWTO or Article about that Matter?

read the help file for the nth patch from PoM.  keep in mind, you can
only do "per-connection" load-balancing if you are doing NAT and/or have
non-provider-independent address space; so any single connection will
only ever get 100K.

-j

--
"Stewie: I'll wait until you're finished. Are you done? Because
 I thought this show was called "Kids Say the Darndest Things," not
 "Old Black Comedians Who Never Shut The Hell Up.""
        --Family Guy