* [LARTC] load balance/redundancy
2000-12-10 5:22 [LARTC] load balance/redundancy Paul
@ 2000-12-10 16:30 ` Arthur
2000-12-10 17:32 ` hesselsp
` (5 subsequent siblings)
6 siblings, 0 replies; 8+ messages in thread
From: Arthur @ 2000-12-10 16:30 UTC (permalink / raw)
To: lartc
<PRE>On Sun, 10 Dec 2000, Paul wrote:
><i> I have looked through the archives, and I can't find the answer(not that
</I>><i> it isn't there)
</I>><i>
</I>><i> I have two connections to the net. I want load balancing and redundancy.
</I>><i>
</I>><i> cable adsl
</I>><i> (24.141.) (64.229)
</I>><i> | |
</I>><i> | |
</I>><i> | |
</I>><i> | |
</I>><i> ------------
</I>><i> | linux |
</I>><i> |redhat 7.0|
</I>><i>
</I>><i> I have no idea were to even start. I would like equal access to both
</I>><i> connections. Please help. I would assume that alot of people do this
</I>><i> already, or want to. A sample config would be very nice.
</I>
Hmm. Try reading the ip route 2 documentation on the ip command, and look
at the 'nexthop' arguments to route add. This will set up multipath routes
which do most of what you want.
There does seem to be something of a discrepancy between the ordinary
default route code and the multipath code in the handling of down
links that might bite you though when one of the links goes down...
Doei, Arthur. (Still figuring that last one out)
--
/\ / | <A HREF="mailto:arthurvl@sci.kun.nl">arthurvl@sci.kun.nl</A> | Work like you don't need the money
/__\ / | A friend is someone with whom | Love like you have never been hurt
/ \/__ | you can dare to be yourself | Dance like there's nobody watching
</PRE>
^ permalink raw reply [flat|nested] 8+ messages in thread* [LARTC] load balance/redundancy
2000-12-10 5:22 [LARTC] load balance/redundancy Paul
2000-12-10 16:30 ` Arthur
@ 2000-12-10 17:32 ` hesselsp
2000-12-10 17:57 ` Arthur
` (4 subsequent siblings)
6 siblings, 0 replies; 8+ messages in thread
From: hesselsp @ 2000-12-10 17:32 UTC (permalink / raw)
To: lartc
<PRE>Well, I think I have the redundancy down... In a kludgy way. Right now I
have two default routes.
route add default gw 24.141.xxx.1
route add default gw 64.229.xxx.1
I can write a script that if one of connections goes down for x number of
pings, then remove the route.
Now for the load balancing.
Can you point me to documentation on iproute? Other then the Advanced
Routing HOWTO, unless I am missing something in it.
Thanks again,
Paul
On Sun, 10 Dec 2000, Arthur van Leeuwen wrote:
><i> On Sun, 10 Dec 2000, Paul wrote:
</I>><i>
</I>><i> > I have looked through the archives, and I can't find the answer(not that
</I>><i> > it isn't there)
</I>><i> >
</I>><i> > I have two connections to the net. I want load balancing and redundancy.
</I>><i> >
</I>><i> > cable adsl
</I>><i> > (24.141.) (64.229)
</I>><i> > | |
</I>><i> > | |
</I>><i> > | |
</I>><i> > | |
</I>><i> > ------------
</I>><i> > | linux |
</I>><i> > |redhat 7.0|
</I>><i> >
</I>><i> > I have no idea were to even start. I would like equal access to both
</I>><i> > connections. Please help. I would assume that alot of people do this
</I>><i> > already, or want to. A sample config would be very nice.
</I>><i>
</I>><i> Hmm. Try reading the ip route 2 documentation on the ip command, and look
</I>><i> at the 'nexthop' arguments to route add. This will set up multipath routes
</I>><i> which do most of what you want.
</I>><i>
</I>><i> There does seem to be something of a discrepancy between the ordinary
</I>><i> default route code and the multipath code in the handling of down
</I>><i> links that might bite you though when one of the links goes down...
</I>><i>
</I>><i> Doei, Arthur. (Still figuring that last one out)
</I>><i>
</I>><i>
</I>
--
HEY! I'm a guy like me!
--Homer
</PRE>
^ permalink raw reply [flat|nested] 8+ messages in thread* [LARTC] load balance/redundancy
2000-12-10 5:22 [LARTC] load balance/redundancy Paul
2000-12-10 16:30 ` Arthur
2000-12-10 17:32 ` hesselsp
@ 2000-12-10 17:57 ` Arthur
2000-12-10 23:50 ` Paul
` (3 subsequent siblings)
6 siblings, 0 replies; 8+ messages in thread
From: Arthur @ 2000-12-10 17:57 UTC (permalink / raw)
To: lartc
<PRE>On Sun, 10 Dec 2000 <A HREF="mailto:hesselsp@ashaman.dhs.org">hesselsp@ashaman.dhs.org</A> wrote:
><i> Well, I think I have the redundancy down... In a kludgy way. Right now I
</I>><i> have two default routes.
</I>
><i> route add default gw 24.141.xxx.1
</I>><i> route add default gw 64.229.xxx.1
</I>
Actually, if I understand the code correctly what you do here is in fact
create a multipath route. A cleaner way to do so is using ip route 2 as
follows:
ip route add default nexthop via 24.141.xxx.1 nexthop via 64.229.xxx.1
This explicitly states that you will be using a multipath route and balances
outgoing routes over the two interfaces.
><i> I can write a script that if one of connections goes down for x number of
</I>><i> pings, then remove the route.
</I>
And here's the crux. It would be nice for the kernel to use its idea of
gateway reachability (in the neighbor cache) to automatically ignore an
upstream hop in case it is dead. However, for multipath routes, no
death detection is done on the gateways in the different hops. This is
quite somewhat different from the single default route behaviour
><i> Now for the load balancing.
</I>
The kernel balances outgoing routes over the upstream interfaces. Unless all
your packets go to the same address, that should balance your traffic
already. Other than that there's some code based on EQL that will flush the
route cache after every packet, thereby smashing the route-balancing down to
packet-level load balancing. I can't seem to find the URL for that code,
though, unfortunately.
><i> Can you point me to documentation on iproute? Other then the Advanced
</I>><i> Routing HOWTO, unless I am missing something in it.
</I>
<A HREF="http://snafu.freedom.org/linux2.2/iproute-notes.html#doc">http://snafu.freedom.org/linux2.2/iproute-notes.html#doc</A>
There's some more interesting stuff on <A HREF="http://snafu.freedom.org/linux2.2/">http://snafu.freedom.org/linux2.2/</A>
as well.
Doei, Arthur.
--
/\ / | <A HREF="mailto:arthurvl@sci.kun.nl">arthurvl@sci.kun.nl</A> | Work like you don't need the money
/__\ / | A friend is someone with whom | Love like you have never been hurt
/ \/__ | you can dare to be yourself | Dance like there's nobody watching
</PRE>
^ permalink raw reply [flat|nested] 8+ messages in thread* [LARTC] load balance/redundancy
2000-12-10 5:22 [LARTC] load balance/redundancy Paul
` (2 preceding siblings ...)
2000-12-10 17:57 ` Arthur
@ 2000-12-10 23:50 ` Paul
2000-12-11 0:11 ` hesselsp
` (2 subsequent siblings)
6 siblings, 0 replies; 8+ messages in thread
From: Paul @ 2000-12-10 23:50 UTC (permalink / raw)
To: lartc
<PRE>Arthur,
Thanks for your help. I tried what you suggested, here is the result:
# /sbin/ip route add default nexthop via 24.141.xxx.1 nexthop via
64.229.xxx.1
RTNETLINK answers: Network is unreachable
So instead, I tried:
# /sbin/ip route add default nexthop via 24.141.xxx.1 dev eth0 nexthop via
64.229.xxx.1 dev ppp0
# ip route ls
64.229.xxx.1 dev ppp0 proto kernel scope link src 64.229.xxx.12
24.141.xxx.0/22 dev eth0 proto kernel scope link src 24.141.xxx.89
127.0.0.0/8 dev lo scope link
default
nexthop via 24.141.xxx.1 dev eth0 weight 1
nexthop via 64.229.xxx.1 dev ppp0 weight 1
and that seemed to work, so I tried:
# /sbin/ip route add default nexthop dev eth0 nexthop dev ppp0
# ip route ls
64.229.xxx.1 dev ppp0 proto kernel scope link src 64.229.xxx.12
24.141.xxx.0/22 dev eth0 proto kernel scope link src 24.141.xxx.89
127.0.0.0/8 dev lo scope link
default
nexthop dev eth0 weight 1
nexthop dev ppp0 weight 1
Now this seems to work. Is there anything wrong with this? Can you take
a guess at why what you suggested didn't work? I think I tried all the
different permutations with addresses, I think the problem must come from
the pppoe interface.
Now all I have to do is kludge something together for my redundancy, set
up firewalling, and masqerading.
Thanks,
Paul
On Sun, 10 Dec 2000, Arthur van Leeuwen wrote:
><i> On Sun, 10 Dec 2000 <A HREF="mailto:hesselsp@ashaman.dhs.org">hesselsp@ashaman.dhs.org</A> wrote:
</I>><i>
</I>><i> > Well, I think I have the redundancy down... In a kludgy way. Right now I
</I>><i> > have two default routes.
</I>><i>
</I>><i> > route add default gw 24.141.xxx.1
</I>><i> > route add default gw 64.229.xxx.1
</I>><i>
</I>><i> Actually, if I understand the code correctly what you do here is in fact
</I>><i> create a multipath route. A cleaner way to do so is using ip route 2 as
</I>><i> follows:
</I>><i>
</I>><i> ip route add default nexthop via 24.141.xxx.1 nexthop via 64.229.xxx.1
</I>><i>
</I>><i> This explicitly states that you will be using a multipath route and balances
</I>><i> outgoing routes over the two interfaces.
</I>><i>
</I>><i> > I can write a script that if one of connections goes down for x number of
</I>><i> > pings, then remove the route.
</I>><i>
</I>><i> And here's the crux. It would be nice for the kernel to use its idea of
</I>><i> gateway reachability (in the neighbor cache) to automatically ignore an
</I>><i> upstream hop in case it is dead. However, for multipath routes, no
</I>><i> death detection is done on the gateways in the different hops. This is
</I>><i> quite somewhat different from the single default route behaviour
</I>><i>
</I>><i> > Now for the load balancing.
</I>><i>
</I>><i> The kernel balances outgoing routes over the upstream interfaces. Unless all
</I>><i> your packets go to the same address, that should balance your traffic
</I>><i> already. Other than that there's some code based on EQL that will flush the
</I>><i> route cache after every packet, thereby smashing the route-balancing down to
</I>><i> packet-level load balancing. I can't seem to find the URL for that code,
</I>><i> though, unfortunately.
</I>><i>
</I>><i> > Can you point me to documentation on iproute? Other then the Advanced
</I>><i> > Routing HOWTO, unless I am missing something in it.
</I>><i>
</I>><i> <A HREF="http://snafu.freedom.org/linux2.2/iproute-notes.html#doc">http://snafu.freedom.org/linux2.2/iproute-notes.html#doc</A>
</I>><i>
</I>><i> There's some more interesting stuff on <A HREF="http://snafu.freedom.org/linux2.2/">http://snafu.freedom.org/linux2.2/</A>
</I>><i> as well.
</I>><i>
</I>><i> Doei, Arthur.
</I>><i>
</I>><i>
</I>
--
HEY! I'm a guy like me!
--Homer
</PRE>
^ permalink raw reply [flat|nested] 8+ messages in thread* [LARTC] load balance/redundancy
2000-12-10 5:22 [LARTC] load balance/redundancy Paul
` (3 preceding siblings ...)
2000-12-10 23:50 ` Paul
@ 2000-12-11 0:11 ` hesselsp
2000-12-11 8:00 ` Arthur
2000-12-11 9:56 ` dan_c
6 siblings, 0 replies; 8+ messages in thread
From: hesselsp @ 2000-12-11 0:11 UTC (permalink / raw)
To: lartc
<PRE>I take part of this back:
On Sun, 10 Dec 2000, Paul wrote:
><i> Arthur,
</I>><i>
</I>><i> Thanks for your help. I tried what you suggested, here is the result:
</I>><i>
</I>><i> # /sbin/ip route add default nexthop via 24.141.xxx.1 nexthop via
</I>><i> 64.229.xxx.1
</I>><i> RTNETLINK answers: Network is unreachable
</I>><i>
</I>><i> So instead, I tried:
</I>><i>
</I>><i> # /sbin/ip route add default nexthop via 24.141.xxx.1 dev eth0 nexthop via
</I>><i> 64.229.xxx.1 dev ppp0
</I>><i>
</I>><i> # ip route ls
</I>><i> 64.229.xxx.1 dev ppp0 proto kernel scope link src 64.229.xxx.12
</I>><i> 24.141.xxx.0/22 dev eth0 proto kernel scope link src 24.141.xxx.89
</I>><i> 127.0.0.0/8 dev lo scope link
</I>><i> default
</I>><i> nexthop via 24.141.xxx.1 dev eth0 weight 1
</I>><i> nexthop via 64.229.xxx.1 dev ppp0 weight 1
</I>
This DOES work.
><i>
</I>><i> and that seemed to work, so I tried:
</I>><i>
</I>><i> # /sbin/ip route add default nexthop dev eth0 nexthop dev ppp0
</I>><i>
</I>><i> # ip route ls
</I>><i> 64.229.xxx.1 dev ppp0 proto kernel scope link src 64.229.xxx.12
</I>><i> 24.141.xxx.0/22 dev eth0 proto kernel scope link src 24.141.xxx.89
</I>><i> 127.0.0.0/8 dev lo scope link
</I>><i> default
</I>><i> nexthop dev eth0 weight 1
</I>><i> nexthop dev ppp0 weight 1
</I>><i>
</I>
This does WEIRD things. I can traceroute to ftp.cdrom.com, but I can't
ping it, nor can I ftp to it.
><i>
</I>><i> Now this seems to work. Is there anything wrong with this? Can you take
</I>><i> a guess at why what you suggested didn't work? I think I tried all the
</I>><i> different permutations with addresses, I think the problem must come from
</I>><i> the pppoe interface.
</I>><i>
</I>><i> Now all I have to do is kludge something together for my redundancy, set
</I>><i> up firewalling, and masqerading.
</I>><i>
</I>><i> Thanks,
</I>><i> Paul
</I>><i>
</I>><i>
</I>><i> On Sun, 10 Dec 2000, Arthur van Leeuwen wrote:
</I>><i>
</I>><i> > On Sun, 10 Dec 2000 <A HREF="mailto:hesselsp@ashaman.dhs.org">hesselsp@ashaman.dhs.org</A> wrote:
</I>><i> >
</I>><i> > > Well, I think I have the redundancy down... In a kludgy way. Right now I
</I>><i> > > have two default routes.
</I>><i> >
</I>><i> > > route add default gw 24.141.xxx.1
</I>><i> > > route add default gw 64.229.xxx.1
</I>><i> >
</I>><i> > Actually, if I understand the code correctly what you do here is in fact
</I>><i> > create a multipath route. A cleaner way to do so is using ip route 2 as
</I>><i> > follows:
</I>><i> >
</I>><i> > ip route add default nexthop via 24.141.xxx.1 nexthop via 64.229.xxx.1
</I>><i> >
</I>><i> > This explicitly states that you will be using a multipath route and balances
</I>><i> > outgoing routes over the two interfaces.
</I>><i> >
</I>><i> > > I can write a script that if one of connections goes down for x number of
</I>><i> > > pings, then remove the route.
</I>><i> >
</I>><i> > And here's the crux. It would be nice for the kernel to use its idea of
</I>><i> > gateway reachability (in the neighbor cache) to automatically ignore an
</I>><i> > upstream hop in case it is dead. However, for multipath routes, no
</I>><i> > death detection is done on the gateways in the different hops. This is
</I>><i> > quite somewhat different from the single default route behaviour
</I>><i> >
</I>><i> > > Now for the load balancing.
</I>><i> >
</I>><i> > The kernel balances outgoing routes over the upstream interfaces. Unless all
</I>><i> > your packets go to the same address, that should balance your traffic
</I>><i> > already. Other than that there's some code based on EQL that will flush the
</I>><i> > route cache after every packet, thereby smashing the route-balancing down to
</I>><i> > packet-level load balancing. I can't seem to find the URL for that code,
</I>><i> > though, unfortunately.
</I>><i> >
</I>><i> > > Can you point me to documentation on iproute? Other then the Advanced
</I>><i> > > Routing HOWTO, unless I am missing something in it.
</I>><i> >
</I>><i> > <A HREF="http://snafu.freedom.org/linux2.2/iproute-notes.html#doc">http://snafu.freedom.org/linux2.2/iproute-notes.html#doc</A>
</I>><i> >
</I>><i> > There's some more interesting stuff on <A HREF="http://snafu.freedom.org/linux2.2/">http://snafu.freedom.org/linux2.2/</A>
</I>><i> > as well.
</I>><i> >
</I>><i> > Doei, Arthur.
</I>><i> >
</I>><i> >
</I>><i>
</I>><i>
</I>
--
HEY! I'm a guy like me!
--Homer
</PRE>
^ permalink raw reply [flat|nested] 8+ messages in thread* [LARTC] load balance/redundancy
2000-12-10 5:22 [LARTC] load balance/redundancy Paul
` (4 preceding siblings ...)
2000-12-11 0:11 ` hesselsp
@ 2000-12-11 8:00 ` Arthur
2000-12-11 9:56 ` dan_c
6 siblings, 0 replies; 8+ messages in thread
From: Arthur @ 2000-12-11 8:00 UTC (permalink / raw)
To: lartc
<PRE>On Sun, 10 Dec 2000, Paul wrote:
><i> Arthur,
</I>><i>
</I>><i> Thanks for your help. I tried what you suggested, here is the result:
</I>><i>
</I>><i> # /sbin/ip route add default nexthop via 24.141.xxx.1 nexthop via
</I>><i> 64.229.xxx.1
</I>><i> RTNETLINK answers: Network is unreachable
</I>
You forgot to setup host routes to 64.229.xxx.1 and 24.141.xxx.1 over the
correct interfaces.
><i> So instead, I tried:
</I>><i>
</I>><i> # /sbin/ip route add default nexthop via 24.141.xxx.1 dev eth0 nexthop via
</I>><i> 64.229.xxx.1 dev ppp0
</I>
Well, that works as well. No host routes needed. :)
><i> # ip route ls
</I>><i> 64.229.xxx.1 dev ppp0 proto kernel scope link src 64.229.xxx.12
</I>><i> 24.141.xxx.0/22 dev eth0 proto kernel scope link src 24.141.xxx.89
</I>><i> 127.0.0.0/8 dev lo scope link
</I>><i> default
</I>><i> nexthop dev eth0 weight 1
</I>><i> nexthop dev ppp0 weight 1
</I>
Ah, yes. You might get problems with the selection of the source address you
come from though. The situation that might occur is a route going over ppp0
using 24.141.xxx.89 as source address. That will probably *not* work.
><i> Now this seems to work. Is there anything wrong with this? Can you take
</I>><i> a guess at why what you suggested didn't work? I think I tried all the
</I>><i> different permutations with addresses, I think the problem must come from
</I>><i> the pppoe interface.
</I>
I don't think the problem comes from the pppoe interface. I've set up stuff
like this with ppp over pptp over ethernet links (*silly* ADSL setup), and
that works as well.
><i> Now all I have to do is kludge something together for my redundancy, set
</I>><i> up firewalling, and masqerading.
</I>
Note: you may want to set up policy rules for dealing with packets that
already have a source or destination address. This will let servers running
on your system that bind to 0.0.0.0/0 answer to requests from both links
over the correct link. Browse through the mailinglist archives for some
hints on how to set that up.
Doei, Arthur.
--
/\ / | <A HREF="mailto:arthurvl@sci.kun.nl">arthurvl@sci.kun.nl</A> | Work like you don't need the money
/__\ / | A friend is someone with whom | Love like you have never been hurt
/ \/__ | you can dare to be yourself | Dance like there's nobody watching
</PRE>
^ permalink raw reply [flat|nested] 8+ messages in thread* [LARTC] load balance/redundancy
2000-12-10 5:22 [LARTC] load balance/redundancy Paul
` (5 preceding siblings ...)
2000-12-11 8:00 ` Arthur
@ 2000-12-11 9:56 ` dan_c
6 siblings, 0 replies; 8+ messages in thread
From: dan_c @ 2000-12-11 9:56 UTC (permalink / raw)
To: lartc
<PRE>
Be attentive : you don't use 24.141.xxx.1 -> xxx should be a number and the "24.141.xxx.1" should be the gateway you're using with the 24.141. ip adress (.videotron.ca?)
and the 64.226.xxx.1 should be the gw your 64.226. ip adress uses (pacbell.net ? :)))) )
Best Regards
Dan Caescu
><i> >
</I>><i> > # /sbin/ip route add default nexthop via 24.141.xxx.1 nexthop via
</I>><i> > 64.229.xxx.1
</I>><i> > RTNETLINK answers: Network is unreachable
</I>><i>
</I>><i> You forgot to setup host routes to 64.229.xxx.1 and 24.141.xxx.1 over the
</I>><i> correct interfaces.
</I>><i>
</I>><i> > So instead, I tried:
</I>><i> >
</I>><i> > # /sbin/ip route add default nexthop via 24.141.xxx.1 dev eth0 nexthop via
</I>><i> > 64.229.xxx.1 dev ppp0
</I>><i>
</I>><i> Well, that works as well. No host routes needed. :)
</I>><i>
</I>><i> > # ip route ls
</I>><i> > 64.229.xxx.1 dev ppp0 proto kernel scope link src 64.229.xxx.12
</I>><i> > 24.141.xxx.0/22 dev eth0 proto kernel scope link src 24.141.xxx.89
</I>><i> > 127.0.0.0/8 dev lo scope link
</I>><i> > default
</I>><i> > nexthop dev eth0 weight 1
</I>><i> > nexthop dev ppp0 weight 1
</I>><i>
</I>><i> Ah, yes. You might get problems with the selection of the source address you
</I>><i> come from though. The situation that might occur is a route going over ppp0
</I>><i> using 24.141.xxx.89 as source address. That will probably *not* work.
</I>><i>
</I>><i> > Now this seems to work. Is there anything wrong with this? Can you take
</I>><i> > a guess at why what you suggested didn't work? I think I tried all the
</I>><i> > different permutations with addresses, I think the problem must come from
</I>><i> > the pppoe interface.
</I>><i>
</I>><i> I don't think the problem comes from the pppoe interface. I've set up stuff
</I>><i> like this with ppp over pptp over ethernet links (*silly* ADSL setup), and
</I>><i> that works as well.
</I>><i>
</I>><i> > Now all I have to do is kludge something together for my redundancy, set
</I>><i> > up firewalling, and masqerading.
</I>><i>
</I>><i> Note: you may want to set up policy rules for dealing with packets that
</I>><i> already have a source or destination address. This will let servers running
</I>><i> on your system that bind to 0.0.0.0/0 answer to requests from both links
</I>><i> over the correct link. Browse through the mailinglist archives for some
</I>><i> hints on how to set that up.
</I>><i>
</I>><i> Doei, Arthur.
</I>><i>
</I>><i> --
</I>><i> /\ / | <A HREF="mailto:arthurvl@sci.kun.nl">arthurvl@sci.kun.nl</A> | Work like you don't need the money
</I>><i> /__\ / | A friend is someone with whom | Love like you have never been hurt
</I>><i> / \/__ | you can dare to be yourself | Dance like there's nobody watching
</I>><i>
</I>><i>
</I>><i> _______________________________________________
</I>><i> LARTC mailing list / <A HREF="mailto:LARTC@mailman.ds9a.nl">LARTC@mailman.ds9a.nl</A>
</I>><i> <A HREF="http://mailman.ds9a.nl/mailman/listinfo/lartc">http://mailman.ds9a.nl/mailman/listinfo/lartc</A> HOWTO: <A HREF="http://ds9a.nl/2.4Routing/">http://ds9a.nl/2.4Routing/</A>
</I>
</PRE>
^ permalink raw reply [flat|nested] 8+ messages in thread