* Re: [LARTC] LoadBalancing on many asimetric different dsl's.
2007-01-22 8:49 [LARTC] LoadBalancing on many asimetric different dsl's sAwAr
@ 2007-01-22 9:03 ` Jordi Segues
2007-01-22 11:18 ` Alex Samad
` (3 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: Jordi Segues @ 2007-01-22 9:03 UTC (permalink / raw)
To: lartc
Hello,
I've done this some montsh ago, with a command like:
ip route add default equalize scope global nexthop via $EXTGW1 dev
$EXTIF1 weight 1 nexthop via $EXTGW2 dev $EXTIF2 weight 1
However, this is not the problem.
While loadbalancing of simple requests worked fine, there where
problems when you worked with connections. I mean HTTPS, of FTP
connection for example.
The problem was fo me that the system trys to send packets of the same
connection throught different gateways, so with different IP source
(each DSL connection was from different ISP). This caused the server
not to understand why the same connection sent packets with 2
different source IP ;)
Well, I hope you understand me.
If you would do real load balancing, and in a proper way, you should
not only do it by link charge, but route packets by connection to.
(routing all packets of the same connection through the same gateway)
This is caused because you must flush the route cache some times (or
packets to a destination will allways take the same route, wich is not
a loadbalance).
So if someone has done it and doesn't have this problem, I'm interested too :)
Thanks!
Jordi Segues
On 22 Jan 2007 09:49:28 +0100, sAwAr <sawar@interia.pl> wrote:
> Hi,
>
> my company have just bought new network and I have question about one problem.
> As in topic we must use few completely different dsl's and balance traffic between them.
> 2M/0,5M 4Mb/0,5M 8M/0,5M
> M=Mb/s
> I've never done such thing before so I have doubts how it will work. If the links are symmetric 2/2 4/4 8/8 there is no problem because with weights I can compensate the difference between them and achieve nice results. But what in my situation?
> My questions are: how to set load balancing to get all links equally loaded and avoid situation when the up load will be full and download almost empty? I believe this situation can happen due to fact that load balancing is based on flows and for example p2p or smpt/pop3 will eat whole upload.
> If my problem isn't clear I'll try to explain it better later.
>
>
> Thanks in advance.
> Pozdrawiam
> sawar
>
> ----------------------------------------------------------------------
> Wolne adresy pocztowe @interia.eu >>> http://link.interia.pl/f19e8
>
> _______________________________________________
> LARTC mailing list
> LARTC@mailman.ds9a.nl
> http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
>
--
Jordi Segués Daina
-------------------------------------------------------
Andorra GSM: (+376) 35 35 68
France GSM: (+33) (0)6 81 88 35 55
E-m@il / MSN: jordisd@gmail.com
AIM: superjordix
Skype: callto://superjordix
-------------------------------------------------------
http://www.JordiX.com
_______________________________________________
LARTC mailing list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: [LARTC] LoadBalancing on many asimetric different dsl's.
2007-01-22 8:49 [LARTC] LoadBalancing on many asimetric different dsl's sAwAr
2007-01-22 9:03 ` Jordi Segues
@ 2007-01-22 11:18 ` Alex Samad
2007-01-22 12:21 ` Jordi Segues
` (2 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: Alex Samad @ 2007-01-22 11:18 UTC (permalink / raw)
To: lartc
[-- Attachment #1.1: Type: text/plain, Size: 4091 bytes --]
On Mon, Jan 22, 2007 at 10:03:21AM +0100, Jordi Segues wrote:
> Hello,
>
> I've done this some montsh ago, with a command like:
> ip route add default equalize scope global nexthop via $EXTGW1 dev
> $EXTIF1 weight 1 nexthop via $EXTGW2 dev $EXTIF2 weight 1
>
> However, this is not the problem.
> While loadbalancing of simple requests worked fine, there where
> problems when you worked with connections. I mean HTTPS, of FTP
> connection for example.
>
> The problem was fo me that the system trys to send packets of the same
> connection throught different gateways, so with different IP source
> (each DSL connection was from different ISP). This caused the server
> not to understand why the same connection sent packets with 2
> different source IP ;)
> Well, I hope you understand me.
>
> If you would do real load balancing, and in a proper way, you should
> not only do it by link charge, but route packets by connection to.
> (routing all packets of the same connection through the same gateway)
> This is caused because you must flush the route cache some times (or
> packets to a destination will allways take the same route, wich is not
> a loadbalance).
>
> So if someone has done it and doesn't have this problem, I'm interested too
> :)
the above is actually covered in the wiki howto. Bu tyou need to setup snat on
each interface, then connection tracking takes care of sending each stream out
the right interface, you need to use snat and not MASQ.
Then you need to setup up some ip rule tables for each of the interfaces.
my ip ru looks like this
0: from all lookup local
200: from 144.132.145.38 lookup cable
201: from 60.241.248.86 lookup adsl
32766: from all lookup main
32767: from all lookup default
my ip r sh tab default
default proto static metric 5
nexthop via 144.132.144.1 dev vlan2 weight 1
nexthop via 10.20.20.230 dev ppp0 weight 20
default via 10.20.20.230 dev ppp0 src 60.241.248.86 metric 20
default via 144.132.144.1 dev vlan2 src 144.132.145.38 metric 30
This works fine for me, I have tracked packets with tcpdump on both the server
and the client.
Alex
>
> Thanks!
>
> Jordi Segues
>
> On 22 Jan 2007 09:49:28 +0100, sAwAr <sawar@interia.pl> wrote:
> >Hi,
> >
> >my company have just bought new network and I have question about one
> >problem.
> >As in topic we must use few completely different dsl's and balance traffic
> >between them.
> >2M/0,5M 4Mb/0,5M 8M/0,5M
> >M=Mb/s
> >I've never done such thing before so I have doubts how it will work. If
> >the links are symmetric 2/2 4/4 8/8 there is no problem because with
> >weights I can compensate the difference between them and achieve nice
> >results. But what in my situation?
> >My questions are: how to set load balancing to get all links equally
> >loaded and avoid situation when the up load will be full and download
> >almost empty? I believe this situation can happen due to fact that load
> >balancing is based on flows and for example p2p or smpt/pop3 will eat
> >whole upload.
> >If my problem isn't clear I'll try to explain it better later.
> >
> >
> >Thanks in advance.
> >Pozdrawiam
> >sawar
> >
> >----------------------------------------------------------------------
> >Wolne adresy pocztowe @interia.eu >>> http://link.interia.pl/f19e8
> >
> >_______________________________________________
> >LARTC mailing list
> >LARTC@mailman.ds9a.nl
> >http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> >
>
>
> --
> Jordi Segués Daina
> -------------------------------------------------------
> Andorra GSM: (+376) 35 35 68
> France GSM: (+33) (0)6 81 88 35 55
> E-m@il / MSN: jordisd@gmail.com
> AIM: superjordix
> Skype: callto://superjordix
> -------------------------------------------------------
> http://www.JordiX.com
> _______________________________________________
> LARTC mailing list
> LARTC@mailman.ds9a.nl
> http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
>
[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 189 bytes --]
[-- Attachment #2: Type: text/plain, Size: 143 bytes --]
_______________________________________________
LARTC mailing list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: [LARTC] LoadBalancing on many asimetric different dsl's.
2007-01-22 8:49 [LARTC] LoadBalancing on many asimetric different dsl's sAwAr
2007-01-22 9:03 ` Jordi Segues
2007-01-22 11:18 ` Alex Samad
@ 2007-01-22 12:21 ` Jordi Segues
2007-01-22 12:41 ` Alex Samad
2007-01-23 0:11 ` sAwAr
4 siblings, 0 replies; 6+ messages in thread
From: Jordi Segues @ 2007-01-22 12:21 UTC (permalink / raw)
To: lartc
> the above is actually covered in the wiki howto. Bu tyou need to setup snat on
> each interface, then connection tracking takes care of sending each stream out
> the right interface, you need to use snat and not MASQ.
Great news :)
And thankyou for the details.
But could you give the link to the wiki howto?
I only found old doc.
Thanks!
>
> Then you need to setup up some ip rule tables for each of the interfaces.
>
>
> my ip ru looks like this
>
> 0: from all lookup local
> 200: from 144.132.145.38 lookup cable
> 201: from 60.241.248.86 lookup adsl
> 32766: from all lookup main
> 32767: from all lookup default
>
>
> my ip r sh tab default
>
> default proto static metric 5
> nexthop via 144.132.144.1 dev vlan2 weight 1
> nexthop via 10.20.20.230 dev ppp0 weight 20
> default via 10.20.20.230 dev ppp0 src 60.241.248.86 metric 20
> default via 144.132.144.1 dev vlan2 src 144.132.145.38 metric 30
>
>
> This works fine for me, I have tracked packets with tcpdump on both the server
> and the client.
>
> Alex
>
>
>
> >
> > Thanks!
> >
> > Jordi Segues
> >
> > On 22 Jan 2007 09:49:28 +0100, sAwAr <sawar@interia.pl> wrote:
> > >Hi,
> > >
> > >my company have just bought new network and I have question about one
> > >problem.
> > >As in topic we must use few completely different dsl's and balance traffic
> > >between them.
> > >2M/0,5M 4Mb/0,5M 8M/0,5M
> > >M=Mb/s
> > >I've never done such thing before so I have doubts how it will work. If
> > >the links are symmetric 2/2 4/4 8/8 there is no problem because with
> > >weights I can compensate the difference between them and achieve nice
> > >results. But what in my situation?
> > >My questions are: how to set load balancing to get all links equally
> > >loaded and avoid situation when the up load will be full and download
> > >almost empty? I believe this situation can happen due to fact that load
> > >balancing is based on flows and for example p2p or smpt/pop3 will eat
> > >whole upload.
> > >If my problem isn't clear I'll try to explain it better later.
> > >
> > >
> > >Thanks in advance.
> > >Pozdrawiam
> > >sawar
> > >
> > >----------------------------------------------------------------------
> > >Wolne adresy pocztowe @interia.eu >>> http://link.interia.pl/f19e8
> > >
> > >_______________________________________________
> > >LARTC mailing list
> > >LARTC@mailman.ds9a.nl
> > >http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> > >
> >
> >
> > --
> > Jordi Segués Daina
> > -------------------------------------------------------
> > Andorra GSM: (+376) 35 35 68
> > France GSM: (+33) (0)6 81 88 35 55
> > E-m@il / MSN: jordisd@gmail.com
> > AIM: superjordix
> > Skype: callto://superjordix
> > -------------------------------------------------------
> > http://www.JordiX.com
> > _______________________________________________
> > LARTC mailing list
> > LARTC@mailman.ds9a.nl
> > http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> >
>
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.6 (GNU/Linux)
>
> iD8DBQFFtJ1/kZz88chpJ2MRAhGKAJ9xthAZnQ/ovr82sa/x5j4BFJGgWwCgvtWa
> dS7qseaia3GnZK/n8szE98Y> =zLpL
> -----END PGP SIGNATURE-----
>
>
> _______________________________________________
> LARTC mailing list
> LARTC@mailman.ds9a.nl
> http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
>
>
>
--
Jordi Segués Daina
-------------------------------------------------------
Andorra GSM: (+376) 35 35 68
France GSM: (+33) (0)6 81 88 35 55
E-m@il / MSN: jordisd@gmail.com
AIM: superjordix
Skype: callto://superjordix
-------------------------------------------------------
http://www.JordiX.com
_______________________________________________
LARTC mailing list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [LARTC] LoadBalancing on many asimetric different dsl's.
2007-01-22 8:49 [LARTC] LoadBalancing on many asimetric different dsl's sAwAr
` (2 preceding siblings ...)
2007-01-22 12:21 ` Jordi Segues
@ 2007-01-22 12:41 ` Alex Samad
2007-01-23 0:11 ` sAwAr
4 siblings, 0 replies; 6+ messages in thread
From: Alex Samad @ 2007-01-22 12:41 UTC (permalink / raw)
To: lartc
[-- Attachment #1.1: Type: text/plain, Size: 4424 bytes --]
On Mon, Jan 22, 2007 at 01:21:32PM +0100, Jordi Segues wrote:
> >the above is actually covered in the wiki howto. Bu tyou need to setup
> >snat on
> >each interface, then connection tracking takes care of sending each stream
> >out
> >the right interface, you need to use snat and not MASQ.
>
> Great news :)
> And thankyou for the details.
> But could you give the link to the wiki howto?
> I only found old doc.
been a while since i had a look, quick google gave me this
http://lartc.org/howto/lartc.rpdb.multiple-links.html
I have this booked market as the wiki
http://linux-net.osdl.org/index.php/Main_Page
But I think the former is what you want
>
> Thanks!
>
> >
> >Then you need to setup up some ip rule tables for each of the interfaces.
> >
> >
> >my ip ru looks like this
> >
> >0: from all lookup local
> >200: from 144.132.145.38 lookup cable
> >201: from 60.241.248.86 lookup adsl
> >32766: from all lookup main
> >32767: from all lookup default
> >
> >
> >my ip r sh tab default
> >
> >default proto static metric 5
> > nexthop via 144.132.144.1 dev vlan2 weight 1
> > nexthop via 10.20.20.230 dev ppp0 weight 20
> >default via 10.20.20.230 dev ppp0 src 60.241.248.86 metric 20
> >default via 144.132.144.1 dev vlan2 src 144.132.145.38 metric 30
> >
> >
> >This works fine for me, I have tracked packets with tcpdump on both the
> >server
> >and the client.
> >
> >Alex
> >
> >
> >
> >>
> >> Thanks!
> >>
> >> Jordi Segues
> >>
> >> On 22 Jan 2007 09:49:28 +0100, sAwAr <sawar@interia.pl> wrote:
> >> >Hi,
> >> >
> >> >my company have just bought new network and I have question about one
> >> >problem.
> >> >As in topic we must use few completely different dsl's and balance
> >traffic
> >> >between them.
> >> >2M/0,5M 4Mb/0,5M 8M/0,5M
> >> >M=Mb/s
> >> >I've never done such thing before so I have doubts how it will work. If
> >> >the links are symmetric 2/2 4/4 8/8 there is no problem because with
> >> >weights I can compensate the difference between them and achieve nice
> >> >results. But what in my situation?
> >> >My questions are: how to set load balancing to get all links equally
> >> >loaded and avoid situation when the up load will be full and download
> >> >almost empty? I believe this situation can happen due to fact that load
> >> >balancing is based on flows and for example p2p or smpt/pop3 will eat
> >> >whole upload.
> >> >If my problem isn't clear I'll try to explain it better later.
> >> >
> >> >
> >> >Thanks in advance.
> >> >Pozdrawiam
> >> >sawar
> >> >
> >> >----------------------------------------------------------------------
> >> >Wolne adresy pocztowe @interia.eu >>> http://link.interia.pl/f19e8
> >> >
> >> >_______________________________________________
> >> >LARTC mailing list
> >> >LARTC@mailman.ds9a.nl
> >> >http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> >> >
> >>
> >>
> >> --
> >> Jordi Segués Daina
> >> -------------------------------------------------------
> >> Andorra GSM: (+376) 35 35 68
> >> France GSM: (+33) (0)6 81 88 35 55
> >> E-m@il / MSN: jordisd@gmail.com
> >> AIM: superjordix
> >> Skype: callto://superjordix
> >> -------------------------------------------------------
> >> http://www.JordiX.com
> >> _______________________________________________
> >> LARTC mailing list
> >> LARTC@mailman.ds9a.nl
> >> http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> >>
> >
> >
> >-----BEGIN PGP SIGNATURE-----
> >Version: GnuPG v1.4.6 (GNU/Linux)
> >
> >iD8DBQFFtJ1/kZz88chpJ2MRAhGKAJ9xthAZnQ/ovr82sa/x5j4BFJGgWwCgvtWa
> >dS7qseaia3GnZK/n8szE98Y=
> >=zLpL
> >-----END PGP SIGNATURE-----
> >
> >
> >_______________________________________________
> >LARTC mailing list
> >LARTC@mailman.ds9a.nl
> >http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> >
> >
> >
>
>
> --
> Jordi Segués Daina
> -------------------------------------------------------
> Andorra GSM: (+376) 35 35 68
> France GSM: (+33) (0)6 81 88 35 55
> E-m@il / MSN: jordisd@gmail.com
> AIM: superjordix
> Skype: callto://superjordix
> -------------------------------------------------------
> http://www.JordiX.com
> _______________________________________________
> LARTC mailing list
> LARTC@mailman.ds9a.nl
> http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
>
[-- Attachment #1.2: Digital signature --]
[-- Type: application/pgp-signature, Size: 189 bytes --]
[-- Attachment #2: Type: text/plain, Size: 143 bytes --]
_______________________________________________
LARTC mailing list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: [LARTC] LoadBalancing on many asimetric different dsl's.
2007-01-22 8:49 [LARTC] LoadBalancing on many asimetric different dsl's sAwAr
` (3 preceding siblings ...)
2007-01-22 12:41 ` Alex Samad
@ 2007-01-23 0:11 ` sAwAr
4 siblings, 0 replies; 6+ messages in thread
From: sAwAr @ 2007-01-23 0:11 UTC (permalink / raw)
To: lartc
Thanks for all your answers. I ask my question in different way because I still don't get answer which will be satysfying for me.
Did anybody set similar configuration in the past? Have someone any suggestions how to set it to configure loadbalancing to avoid situation when one link is empty or only upload is used and other links are full. Does weights ensure that upload and download on all links with different up/down speeds will be equally loaded?
Pozdrawiam
sawar
> On Mon, Jan 22, 2007 at 01:21:32PM +0100, Jordi Segues wrote:
> > >the above is actually covered in the wiki howto. Bu tyou need to setup
>
> > >snat on
> > >each interface, then connection tracking takes care of sending each
> stream
> > >out
> > >the right interface, you need to use snat and not MASQ.
> >
> > Great news :)
> > And thankyou for the details.
> > But could you give the link to the wiki howto?
> > I only found old doc.
> been a while since i had a look, quick google gave me this
>
> http://lartc.org/howto/lartc.rpdb.multiple-links.html
>
> I have this booked market as the wiki
> http://linux-net.osdl.org/index.php/Main_Page
>
> But I think the former is what you want
>
> >
> > Thanks!
> >
> > >
> > >Then you need to setup up some ip rule tables for each of the
> interfaces.
> > >
> > >
> > >my ip ru looks like this
> > >
> > >0: from all lookup local
> > >200: from 144.132.145.38 lookup cable
> > >201: from 60.241.248.86 lookup adsl
> > >32766: from all lookup main
> > >32767: from all lookup default
> > >
> > >
> > >my ip r sh tab default
> > >
> > >default proto static metric 5
> > > nexthop via 144.132.144.1 dev vlan2 weight 1
> > > nexthop via 10.20.20.230 dev ppp0 weight 20
> > >default via 10.20.20.230 dev ppp0 src 60.241.248.86 metric 20
> > >default via 144.132.144.1 dev vlan2 src 144.132.145.38 metric 30
> > >
> > >
> > >This works fine for me, I have tracked packets with tcpdump on both the
>
> > >server
> > >and the client.
> > >
> > >Alex
> > >
> > >
> > >
> > >>
> > >> Thanks!
> > >>
> > >> Jordi Segues
> > >>
> > >> On 22 Jan 2007 09:49:28 +0100, sAwAr >sawar@interia.pl> wrote:
> > >> >Hi,
> > >> >
> > >> >my company have just bought new network and I have question about
> one
> > >> >problem.
> > >> >As in topic we must use few completely different dsl's and balance
> > >traffic
> > >> >between them.
> > >> >2M/0,5M 4Mb/0,5M 8M/0,5M
> > >> >M=Mb/s
> > >> >I've never done such thing before so I have doubts how it will work.
> If
> > >> >the links are symmetric 2/2 4/4 8/8 there is no problem because
> with
> > >> >weights I can compensate the difference between them and achieve
> nice
> > >> >results. But what in my situation?
> > >> >My questions are: how to set load balancing to get all links
> equally
> > >> >loaded and avoid situation when the up load will be full and
> download
> > >> >almost empty? I believe this situation can happen due to fact that
> load
> > >> >balancing is based on flows and for example p2p or smpt/pop3 will
> eat
> > >> >whole upload.
> > >> >If my problem isn't clear I'll try to explain it better later.
> > >> >
> > >> >
> > >> >Thanks in advance.
> > >> >Pozdrawiam
> > >> >sawar
> > >> >
> > >>
> >----------------------------------------------------------------------
> > >> >Wolne adresy pocztowe @interia.eu >>> http://link.interia.pl/f19e8
> > >> >
> > >> >_______________________________________________
> > >> >LARTC mailing list
> > >> >LARTC@mailman.ds9a.nl
> > >> >http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> > >> >
> > >>
> > >>
> > >> --
> > >> Jordi Segués Daina
> > >> -------------------------------------------------------
> > >> Andorra GSM: (+376) 35 35 68
> > >> France GSM: (+33) (0)6 81 88 35 55
> > >> E-m@il / MSN: jordisd@gmail.com
> > >> AIM: superjordix
> > >> Skype: callto://superjordix
> > >> -------------------------------------------------------
> > >> http://www.JordiX.com
> > >> _______________________________________________
> > >> LARTC mailing list
> > >> LARTC@mailman.ds9a.nl
> > >> http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> > >>
> > >
> > >
> > >-----BEGIN PGP SIGNATURE-----
> > >Version: GnuPG v1.4.6 (GNU/Linux)
> > >
> > >iD8DBQFFtJ1/kZz88chpJ2MRAhGKAJ9xthAZnQ/ovr82sa/x5j4BFJGgWwCgvtWa
> > >dS7qseaia3GnZK/n8szE98Y> > >=zLpL
> > >-----END PGP SIGNATURE-----
> > >
> > >
> > >_______________________________________________
> > >LARTC mailing list
> > >LARTC@mailman.ds9a.nl
> > >http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> > >
> > >
> > >
> >
> >
> > --
> > Jordi Segués Daina
> > -------------------------------------------------------
> > Andorra GSM: (+376) 35 35 68
> > France GSM: (+33) (0)6 81 88 35 55
> > E-m@il / MSN: jordisd@gmail.com
> > AIM: superjordix
> > Skype: callto://superjordix
> > -------------------------------------------------------
> > http://www.JordiX.com
> > _______________________________________________
> > LARTC mailing list
> > LARTC@mailman.ds9a.nl
> > http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
> >
>
>
----------------------------------------------------------------------
Co robi Indianin w banku? Zobacz >> http://link.interia.pl/f19e4
_______________________________________________
LARTC mailing list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc
^ permalink raw reply [flat|nested] 6+ messages in thread