Help with Load Balancing

Help with Load Balancing

[Ricardo Klein]

I think IPRoute is the one who should make the magic, but, if anyone
can help me here, even pointing me in the right way....

I know I can split my 2 connections in a static way, making lan subnet
A go trough uplink 1 and lan subnet B trough uplink2, but, there is
any way to make this "automatic" like "Hey iproute2, use the least
used uplink to let users fly"

I know, if user A is using uplink1 it should go trough that link until
the end of the navigation, but, later in new requests he should be
able to start the connection using uplink 2 if uplink 1 is starving.

Is there any way to reach that with Linux?


--
Att...

Ricardo Felipe Klein
klein.rfk@gmail.com

Re: Help with Load Balancing

[Andrew Beverley]

On Tue, 2013-07-16 at 00:23 -0300, Ricardo Klein wrote:
> I think IPRoute is the one who should make the magic, but, if anyone
> can help me here, even pointing me in the right way....
> 
> I know I can split my 2 connections in a static way, making lan subnet
> A go trough uplink 1 and lan subnet B trough uplink2, but, there is
> any way to make this "automatic" like "Hey iproute2, use the least
> used uplink to let users fly"
> 
> I know, if user A is using uplink1 it should go trough that link until
> the end of the navigation, but, later in new requests he should be
> able to start the connection using uplink 2 if uplink 1 is starving.
> 
> Is there any way to reach that with Linux?

AFAIK, there is no "automagic" way of doing exactly what you want.
However, I have had good experience with just randomly splitting new
connections between 2 uplinks (or more accurately splitting every other
new connection between each link). Depending on your number of users, as
a general rule this will share equally between links (certainly a lot
better than doing it between subnets).

This is a tutorial I have used:

http://www.sysresccd.org/Sysresccd-Networking-EN-Iptables-and-netfilter-load-balancing-using-connmark

And this is my project:

http://andybev.com/index.php/PortalShaper

Andy

Re: Help with Load Balancing

[Eliezer Croitoru]

You cannot do a Magic way of what you want but as Andrew stated you can
LB between two links.
What is the scenario you do have in hands??
iproute is a route level policy\rules.
If you would have a smarter system it would probably taken a snapshot of
the each uplink every specific interval and calculate the global usage
of the link balancing and would mark more connections based on the least
loaded connection.
From the admin perspective it could be something like "dont route using
uplink1 but use uplink2".
The above algorithm is pretty simple if you have uplink1 and uplink2
which you are not afraid both of them to be down.
Once you have the obstacle of "I'm afraid that the link will go down"
you can play with whatever routing you want since the user will not feel
it in most cases.

Eliezer

On 07/16/2013 06:23 AM, Ricardo Klein wrote:
> I think IPRoute is the one who should make the magic, but, if anyone
> can help me here, even pointing me in the right way....
> 
> I know I can split my 2 connections in a static way, making lan subnet
> A go trough uplink 1 and lan subnet B trough uplink2, but, there is
> any way to make this "automatic" like "Hey iproute2, use the least
> used uplink to let users fly"
> 
> I know, if user A is using uplink1 it should go trough that link until
> the end of the navigation, but, later in new requests he should be
> able to start the connection using uplink 2 if uplink 1 is starving.
> 
> Is there any way to reach that with Linux?
> 
> 
> --
> Att...
> 
> Ricardo Felipe Klein
> klein.rfk@gmail.com
> --
> To unsubscribe from this list: send the line "unsubscribe netfilter" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 

Re: Help with Load Balancing

[Ricardo Klein]

Eliezer,

This "above algorithm is pretty simple" exists or I need to create one myself?
And, if I will need to write my own LoadBalancer algorithm, then, I
cold implement some time of uplink checking to avoid downtime right?
--
Att...

Ricardo Felipe Klein
klein.rfk@gmail.com


On Tue, Jul 16, 2013 at 6:00 PM, Eliezer Croitoru <eliezer@ngtech.co.il> wrote:
> You cannot do a Magic way of what you want but as Andrew stated you can
> LB between two links.
> What is the scenario you do have in hands??
> iproute is a route level policy\rules.
> If you would have a smarter system it would probably taken a snapshot of
> the each uplink every specific interval and calculate the global usage
> of the link balancing and would mark more connections based on the least
> loaded connection.
> From the admin perspective it could be something like "dont route using
> uplink1 but use uplink2".
> The above algorithm is pretty simple if you have uplink1 and uplink2
> which you are not afraid both of them to be down.
> Once you have the obstacle of "I'm afraid that the link will go down"
> you can play with whatever routing you want since the user will not feel
> it in most cases.
>
> Eliezer
>
> On 07/16/2013 06:23 AM, Ricardo Klein wrote:
>> I think IPRoute is the one who should make the magic, but, if anyone
>> can help me here, even pointing me in the right way....
>>
>> I know I can split my 2 connections in a static way, making lan subnet
>> A go trough uplink 1 and lan subnet B trough uplink2, but, there is
>> any way to make this "automatic" like "Hey iproute2, use the least
>> used uplink to let users fly"
>>
>> I know, if user A is using uplink1 it should go trough that link until
>> the end of the navigation, but, later in new requests he should be
>> able to start the connection using uplink 2 if uplink 1 is starving.
>>
>> Is there any way to reach that with Linux?
>>
>>
>> --
>> Att...
>>
>> Ricardo Felipe Klein
>> klein.rfk@gmail.com
>> --
>> To unsubscribe from this list: send the line "unsubscribe netfilter" in
>> the body of a message to majordomo@vger.kernel.org
>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>
>

Re: Help with Load Balancing

[Eliezer Croitoru]

Yes indeed.
you can try to use already made products such as vyatta or zeroshell or
ipcon or others that support dual wan connection to make sure what they
did there.
Ask if you need the developer of zeroshell...
He seems like a nice guy.
Juts forward him this main And I hope he will have sometime for you.

Eliezer

On 07/19/2013 07:24 AM, Ricardo Klein wrote:
> Eliezer,
> 
> This "above algorithm is pretty simple" exists or I need to create one myself?
> And, if I will need to write my own LoadBalancer algorithm, then, I
> cold implement some time of uplink checking to avoid downtime right?
> --
> Att...
> 
> Ricardo Felipe Klein
> klein.rfk@gmail.com
> 
> 
> On Tue, Jul 16, 2013 at 6:00 PM, Eliezer Croitoru <eliezer@ngtech.co.il> wrote:
>> You cannot do a Magic way of what you want but as Andrew stated you can
>> LB between two links.
>> What is the scenario you do have in hands??
>> iproute is a route level policy\rules.
>> If you would have a smarter system it would probably taken a snapshot of
>> the each uplink every specific interval and calculate the global usage
>> of the link balancing and would mark more connections based on the least
>> loaded connection.
>> From the admin perspective it could be something like "dont route using
>> uplink1 but use uplink2".
>> The above algorithm is pretty simple if you have uplink1 and uplink2
>> which you are not afraid both of them to be down.
>> Once you have the obstacle of "I'm afraid that the link will go down"
>> you can play with whatever routing you want since the user will not feel
>> it in most cases.
>>
>> Eliezer
>>
>> On 07/16/2013 06:23 AM, Ricardo Klein wrote:
>>> I think IPRoute is the one who should make the magic, but, if anyone
>>> can help me here, even pointing me in the right way....
>>>
>>> I know I can split my 2 connections in a static way, making lan subnet
>>> A go trough uplink 1 and lan subnet B trough uplink2, but, there is
>>> any way to make this "automatic" like "Hey iproute2, use the least
>>> used uplink to let users fly"
>>>
>>> I know, if user A is using uplink1 it should go trough that link until
>>> the end of the navigation, but, later in new requests he should be
>>> able to start the connection using uplink 2 if uplink 1 is starving.
>>>
>>> Is there any way to reach that with Linux?
>>>
>>>
>>> --
>>> Att...
>>>
>>> Ricardo Felipe Klein
>>> klein.rfk@gmail.com
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe netfilter" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>
>>