From mboxrd@z Thu Jan 1 00:00:00 1970 From: Kenneth Kalmer Date: Sat, 23 Apr 2005 21:34:33 +0000 Subject: [LARTC] Spill over Message-Id: MIME-Version: 1 Content-Type: multipart/mixed; boundary="===============0529000984==" List-Id: To: lartc@vger.kernel.org --===============0529000984== Content-Type: multipart/alternative; boundary="----=_Part_2060_25831762.1114292073018" ------=_Part_2060_25831762.1114292073018 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline List I need some help, advice or just a starting point on the following=20 situation: Link A - 64kbps leased line Link B - 512kbps ADSL line Is it possible to have Link A saturated constantly and have the excess=20 traffic "spill over" onto Link B? I know it's possible to have packets sent= =20 down links in a round-robin fashion and I've read in the howto on load=20 sharing over multiple interfaces ( http://lartc.org/howto/lartc.loadshare.html), but I do not have control ove= r=20 the termination of the link at the ISP's (two different one as well). Also= =20 note that splitting different protocols over each of these links are not=20 possible in our case. Reason being, Link A is a more reliable and more expensive link, so I need= =20 to over-use it's capacity if it we're, and use the cheaper ADSL (link B)=20 offering to keep al services running when the leased line (A) is saturated. Any tips, suggestions and comments would be welcomed. Regards --=20 Kenneth Kalmer kenneth.kalmer@gmail.com http://opensourcery.blogspot.com ------=_Part_2060_25831762.1114292073018 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline List

I need some help, advice or just a starting point on the following situatio= n:

Link A - 64kbps leased line
Link B - 512kbps ADSL line

Is it possible to have Link A saturated constantly and have the excess traffic "spill over" onto Link B? I know it's possible to have pa= ckets sent down links in a round-robin fashion and I've read in the howto on load sharing over multiple interfaces (http://lartc.org/h= owto/lartc.loadshare.html), but I do not have control over the termination of the link at the ISP's (two different one as well). Also note that splitting different protocols over each of these links are not possible in our case.

Reason being, Link A is a more reliable and more expensive link, so I need to over-use it's capacity if it we're, and use the cheaper ADSL (link B) offering to keep al services running when the leased line (A) is saturated.

Any tips, suggestions and comments would be welcomed.

Regards

--

Kenneth Kalmer
kenneth.kalmer@gmail.com
http://opensourcery.blogspot.com ------=_Part_2060_25831762.1114292073018-- --===============0529000984== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc --===============0529000984==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: Taylor Grant Date: Sat, 23 Apr 2005 22:11:23 +0000 Subject: Re: [LARTC] Spill over Message-Id: <426AC80B.6000009@riverviewtech.net> List-Id: References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: lartc@vger.kernel.org > List > > I need some help, advice or just a starting point on the following > situation: > > Link A - 64kbps leased line > Link B - 512kbps ADSL line > > Is it possible to have Link A saturated constantly and have the excess > traffic "spill over" onto Link B? I know it's possible to have packets > sent down links in a round-robin fashion and I've read in the howto on > load sharing over multiple interfaces > (http://lartc.org/howto/lartc.loadshare.html), but I do not have control > over the termination of the link at the ISP's (two different one as > well). Also note that splitting different protocols over each of these > links are not possible in our case. > > Reason being, Link A is a more reliable and more expensive link, so I > need to over-use it's capacity if it we're, and use the cheaper ADSL > (link B) offering to keep al services running when the leased line (A) > is saturated. > > Any tips, suggestions and comments would be welcomed. > > Regards Off hand the thing that comes to mind would be to use an IPTables rule to estimate the rate of flow (I'm not sure what match this is (limit?) but I do think there is one.) and reset the route or mark traffic and have the routing table reroute traffic that is marked. Keep in mind that this will only roughly saturate your 64 kbps link on your outbound traffic. It will do nothing to control the % utilization on the traffic that comes back in to you. Can I ask why you are wanting to saturate tech 64 kbps leased line? Are you trying to encourage management that you need a faster leased line by going to them with graphs stating that the ADSL they purchased did not really solve the problem like they were wanting it to? ;) Another not so nice trick that you could do is just send bogus traffic, via packet gen, out the 64k at a lower priority than the rest of your legitimate traffic thus insurring that the 64 kbps line is full all the time even if you don't have that much legitimate traffic on it. Yes I should probably be thumped or at least pelted with Nerf Darts for this idea, but it is an answer if you are just trying to saturate the 64 kbps line. (Time to run and hide as I hear the Nerf guns being pumped up!) Grant. . . . _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Chris Bennett" Date: Sat, 23 Apr 2005 23:18:19 +0000 Subject: Re: [LARTC] Spill over Message-Id: <001401c5485a$bc8c6060$200fa8c0@DELTA> MIME-Version: 1 Content-Type: multipart/mixed; boundary="===============2128599656==" List-Id: References: In-Reply-To: To: lartc@vger.kernel.org This is a multi-part message in MIME format. --===============2128599656== Content-Type: multipart/alternative; boundary="----=_NextPart_000_0011_01C54830.D3A34590" This is a multi-part message in MIME format. ------=_NextPart_000_0011_01C54830.D3A34590 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable You can't split a particular IP connection between two links, but can = instead only determine which link a particular connection will occur on. = Given this, it sounds like you want to have some way to detect that = Link A is already saturated and then send all further connections to = Link B until Link A is no longer saturated. Maybe someone can tell you how to do that if that's really what you want = to do (others here know far more about this than me), but my guess is = you really don't want to do that. With the huge bandwidth disparity = between the two links, route cacheing, and the inability know how much = bandwidth any particular conneciton will consume, I think you'd end up = with a giant mess... those people with connections unlucky enough to end = up on Link A would probably be very unhappy people indeed. Generally speaking I think it would make more sense to put all traffic = over Link B, and then use Link A only for emergencies. Maybe route the = most critical traffic over Link A if you really want to feel like its = being utilized as something other than a pure backup, but personally I = wouldn't even do that. Just because Link A is more reliable and more expensive doesn't mean it = makes sense to use it as your primary conduit. With Link B having eight = times the bandwidth, it seems the obvious choice as the primary. Use = it, and keep the users happy most of the time (instead of making them = miserable most of the time). On the rare ocassions it goes down, use = bandwidth shaping to make sure the highest priority traffic gets access = to Link A first. In all the time I've used DSL, I've had severe outages twice for reasons = other than standard maintenance. In both cases (in two separate = locations), the cause was the ILEC phone company mistakingly dropping = the wire pair while doing other work (freakin took over a week in each = case to get my connectivity back!!). This sort of thing could just as = easily happen with a leased line though, so I'm not really sure I buy = that the leased line is really more reliable than DSL line from a high = quality ISP. Although maybe a particular SLA makes it so in some legal = sense since you can then sue someone. Personally, if your leased line = really costs more than the DSL, I'd get rid of it and get a 2nd DSL line = from another provider and use that as your backup instead. Anyway, I guess my main point is that the high cost of your leased line = might be clouding your thinking on this. I wouldn't let the comparitive = cost be your guiding light here. Go with what makes sense from a = technology perspective, and don't guilt yourself into trying to get full = utilization out of the slow link just because it costs more. ----- Original Message -----=20 From: Kenneth Kalmer=20 To: lartc=20 Sent: Saturday, April 23, 2005 4:34 PM Subject: [LARTC] Spill over List I need some help, advice or just a starting point on the following = situation: Link A - 64kbps leased line Link B - 512kbps ADSL line Is it possible to have Link A saturated constantly and have the excess = traffic "spill over" onto Link B? I know it's possible to have packets = sent down links in a round-robin fashion and I've read in the howto on = load sharing over multiple interfaces = (http://lartc.org/howto/lartc.loadshare.html), but I do not have control = over the termination of the link at the ISP's (two different one as = well). Also note that splitting different protocols over each of these = links are not possible in our case. Reason being, Link A is a more reliable and more expensive link, so I = need to over-use it's capacity if it we're, and use the cheaper ADSL = (link B) offering to keep al services running when the leased line (A) = is saturated. Any tips, suggestions and comments would be welcomed. Regards --=20 Kenneth Kalmer kenneth.kalmer@gmail.com http://opensourcery.blogspot.com=20 -------------------------------------------------------------------------= ----- _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc ------=_NextPart_000_0011_01C54830.D3A34590 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
You can't split a particular IP = connection=20 between two links, but can instead only determine which link a=20 particular connection will occur on.  Given this, it sounds = like you=20 want to have some way to detect that Link A is already saturated and = then send=20 all further connections to Link B until Link A is no longer=20 saturated.
 
Maybe someone can tell you how = to do that=20 if that's really what you want to do (others here know far more about = this than=20 me), but my guess is you really don't want to do that.  With = the=20 huge bandwidth disparity between the two links, route = cacheing, and=20 the inability know how much bandwidth any particular conneciton = will=20 consume, I think you'd end up with a giant mess... those people with = connections=20 unlucky enough to end up on Link A would probably be very unhappy people = indeed.
 
Generally speaking I think it = would make=20 more sense to put all traffic over Link B, and then use Link A only for=20 emergencies.  Maybe route the most critical traffic over Link A if = you=20 really want to feel like its being utilized as something other than a = pure=20 backup, but personally I wouldn't even do that.
 
Just because Link A is more = reliable and=20 more expensive doesn't mean it makes sense to use it as your primary=20 conduit.  With Link B having eight times the bandwidth, it=20 seems the obvious choice as the primary.  Use it, and keep the = users=20 happy most of the time (instead of making them miserable most of = the=20 time).  On the rare ocassions it goes down, use bandwidth shaping = to make=20 sure the highest priority traffic gets access to Link A = first.
 
In all the time I've used DSL, = I've=20 had severe outages twice for reasons other than standard=20 maintenance.  In both cases (in two separate locations), the cause = was the=20 ILEC phone company mistakingly dropping the wire pair while doing other = work=20 (freakin took over a week in each case to get my connectivity = back!!). =20 This sort of thing could just as easily happen with a leased line = though, so I'm=20 not really sure I buy that the leased line is really more reliable than = DSL line=20 from a high quality ISP.  Although maybe a particular SLA = makes it so=20 in some legal sense since you can then sue someone.  Personally, if = your=20 leased line really costs more than the DSL, I'd get rid of it and get a = 2nd DSL=20 line from another provider and use that as your backup = instead.
 
Anyway, I guess my main point = is that the=20 high cost of your leased line might be clouding your thinking on = this.  I=20 wouldn't let the comparitive cost be your guiding light here.  = Go with=20 what makes sense from a technology perspective, and don't guilt yourself = into=20 trying to get full utilization out of the slow link just because it = costs=20 more.
 
----- Original Message -----
From:=20 Kenneth Kalmer
To: lartc
Sent: Saturday, April 23, 2005 = 4:34=20 PM
Subject: [LARTC] Spill = over

List

I need some help, advice or just a starting = point=20 on the following situation:

Link A - 64kbps leased line
Link = B -=20 512kbps ADSL line

Is it possible to have Link A saturated = constantly=20 and have the excess traffic "spill over" onto Link B? I know it's = possible to=20 have packets sent down links in a round-robin fashion and I've read in = the=20 howto on load sharing over multiple interfaces (http://lartc.org/how= to/lartc.loadshare.html),=20 but I do not have control over the termination of the link at the = ISP's (two=20 different one as well). Also note that splitting different protocols = over each=20 of these links are not possible in our case.

Reason being, Link = A is a=20 more reliable and more expensive link, so I need to over-use it's = capacity if=20 it we're, and use the cheaper ADSL (link B) offering to keep al = services=20 running when the leased line (A) is saturated.

Any tips, = suggestions=20 and comments would be welcomed.

Regards

-- =

Kenneth=20 Kalmer
kenneth.kalmer@gmail.com
= http://opensourcery.blogspot.co= m=20


_______________________________________________
LARTC = mailing=20 = list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/l= istinfo/lartc
------=_NextPart_000_0011_01C54830.D3A34590-- --===============2128599656== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc --===============2128599656==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: Kenneth Kalmer Date: Mon, 25 Apr 2005 07:48:20 +0000 Subject: Re: [LARTC] Spill over Message-Id: MIME-Version: 1 Content-Type: multipart/mixed; boundary="===============0919614172==" List-Id: References: In-Reply-To: To: lartc@vger.kernel.org --===============0919614172== Content-Type: multipart/alternative; boundary="----=_Part_5360_21792979.1114415300859" ------=_Part_5360_21792979.1114415300859 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Taylor & Chris (and the list) The arguments behind my choice here is cost driven, the 64kbps line is a=20 fixed monthly rate for unlimited use, the 512kbps line costs us roughly=20 ZAR250 per 3GB of usage. This can get quite expensive as the lines in=20 question is for a college and we all know what students do to bandwidth :) Taken the amount we pay every month for the 64kbps line it's more economica= l=20 to over utilize the link as a primary connection than to have it lying=20 around as a backup. South Africa and data connections don't go well in the= =20 same sentence... As Chris suggested, I need something that can detect when Link A is=20 saturated and then redirect the traffic over Link B until there is availabl= e=20 bandwidth on Link A again. The rate limit trick of Taylor might work once I= =20 get to understand the usage patterns of these students. But for at least th= e=20 first 3 months I won't have proper data at my disposal. Thanks for your replies! On 4/24/05, Chris Bennett wrote: >=20 > You can't split a particular IP connection between two links, but can=20 > instead only determine which link a particular connection will occur on.= =20 > Given this, it sounds like you want to have some way to detect that Link = A=20 > is already saturated and then send all further connections to Link B unti= l=20 > Link A is no longer saturated. > Maybe someone can tell you how to do that if that's really what you want= =20 > to do (others here know far more about this than me), but my guess is you= =20 > really don't want to do that. With the huge bandwidth disparity between t= he=20 > two links, route cacheing, and the inability know how much bandwidth any= =20 > particular conneciton will consume, I think you'd end up with a giant=20 > mess... those people with connections unlucky enough to end up on Link A= =20 > would probably be very unhappy people indeed. > Generally speaking I think it would make more sense to put all traffic= =20 > over Link B, and then use Link A only for emergencies. Maybe route the mo= st=20 > critical traffic over Link A if you really want to feel like its being=20 > utilized as something other than a pure backup, but personally I wouldn't= =20 > even do that. > Just because Link A is more reliable and more expensive doesn't mean it= =20 > makes sense to use it as your primary conduit. With Link B having eight= =20 > times the bandwidth, it seems the obvious choice as the primary. Use it, = and=20 > keep the users happy most of the time (instead of making them miserable m= ost=20 > of the time). On the rare ocassions it goes down, use bandwidth shaping t= o=20 > make sure the highest priority traffic gets access to Link A first. > In all the time I've used DSL, I've had severe outages twice for reasons= =20 > other than standard maintenance. In both cases (in two separate locations= ),=20 > the cause was the ILEC phone company mistakingly dropping the wire pair= =20 > while doing other work (freakin took over a week in each case to get my= =20 > connectivity back!!). This sort of thing could just as easily happen with= a=20 > leased line though, so I'm not really sure I buy that the leased line is= =20 > really more reliable than DSL line from a high quality ISP. Although mayb= e a=20 > particular SLA makes it so in some legal sense since you can then sue=20 > someone. Personally, if your leased line really costs more than the DSL, = I'd=20 > get rid of it and get a 2nd DSL line from another provider and use that a= s=20 > your backup instead. > Anyway, I guess my main point is that the high cost of your leased line= =20 > might be clouding your thinking on this. I wouldn't let the comparitive c= ost=20 > be your guiding light here. Go with what makes sense from a technology=20 > perspective, and don't guilt yourself into trying to get full utilization= =20 > out of the slow link just because it costs more. > =20 > ----- Original Message -----=20 > *From:* Kenneth Kalmer =20 > *To:* lartc =20 > *Sent:* Saturday, April 23, 2005 4:34 PM > *Subject:* [LARTC] Spill over >=20 > List >=20 > I need some help, advice or just a starting point on the following=20 > situation: >=20 > Link A - 64kbps leased line > Link B - 512kbps ADSL line >=20 > Is it possible to have Link A saturated constantly and have the excess=20 > traffic "spill over" onto Link B? I know it's possible to have packets se= nt=20 > down links in a round-robin fashion and I've read in the howto on load=20 > sharing over multiple interfaces ( > http://lartc.org/howto/lartc.loadshare.html), but I do not have control= =20 > over the termination of the link at the ISP's (two different one as well)= .=20 > Also note that splitting different protocols over each of these links are= =20 > not possible in our case. >=20 > Reason being, Link A is a more reliable and more expensive link, so I nee= d=20 > to over-use it's capacity if it we're, and use the cheaper ADSL (link B)= =20 > offering to keep al services running when the leased line (A) is saturate= d. >=20 > Any tips, suggestions and comments would be welcomed. >=20 > Regards >=20 > --=20 >=20 > Kenneth Kalmer > kenneth.kalmer@gmail.com > http://opensourcery.blogspot.com=20 >=20 > ------------------------------ >=20 > _______________________________________________ > LARTC mailing list > LARTC@mailman.ds9a.nl > http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc >=20 >=20 > _______________________________________________ > LARTC mailing list > LARTC@mailman.ds9a.nl > http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc >=20 >=20 >=20 --=20 Kenneth Kalmer kenneth.kalmer@gmail.com http://opensourcery.blogspot.com ------=_Part_5360_21792979.1114415300859 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Taylor & Chris (and the list)

The arguments behind my choice here is cost driven, the 64kbps line is a fixed monthly rate for unlimited use, the 512kbps line costs us roughly ZAR250 per 3GB of usage. This can get quite expensive as the lines in question is for a college and we all know what students do to bandwidth :)

Taken the amount we pay every month for the 64kbps line it's more economical to over utilize the link as a primary connection than to have it lying around as a backup. South Africa and data connections don't go well in the same sentence...

As Chris suggested, I need something that can detect when Link A is saturated and then redirect the traffic over Link B until there is available bandwidth on Link A again. The rate limit trick of Taylor might work once I get to understand the usage patterns of these students. But for at least the first 3 months I won't have proper data at my disposal.

Thanks for your replies!

On 4/24/05, Chris Bennett <chris@symbio.com> wrote:
You can't split a particular IP = connection=20 between two links, but can instead only determine which link a=20 particular connection will occur on.  Given this, it sounds like = you=20 want to have some way to detect that Link A is already saturated and then s= end=20 all further connections to Link B until Link A is no longer=20 saturated.
 
Maybe someone can tell you how t= o do that=20 if that's really what you want to do (others here know far more about this = than=20 me), but my guess is you really don't want to do that.  With the= =20 huge bandwidth disparity between the two links, route cacheing, a= nd=20 the inability know how much bandwidth any particular conneciton will= =20 consume, I think you'd end up with a giant mess... those people with connec= tions=20 unlucky enough to end up on Link A would probably be very unhappy people=20 indeed.
 
Generally speaking I think it wo= uld make=20 more sense to put all traffic over Link B, and then use Link A only for=20 emergencies.  Maybe route the most critical traffic over Link A if you= =20 really want to feel like its being utilized as something other than a pure= =20 backup, but personally I wouldn't even do that.
 
Just because Link A is more reli= able and=20 more expensive doesn't mean it makes sense to use it as your primary=20 conduit.  With Link B having eight times the bandwidth, it=20 seems the obvious choice as the primary.  Use it, and keep the us= ers=20 happy most of the time (instead of making them miserable most of the= =20 time).  On the rare ocassions it goes down, use bandwidth shaping to m= ake=20 sure the highest priority traffic gets access to Link A first.
 
In all the time I've used DSL, I= 've=20 had severe outages twice for reasons other than standard=20 maintenance.  In both cases (in two separate locations), the cause was= the=20 ILEC phone company mistakingly dropping the wire pair while doing other wor= k=20 (freakin took over a week in each case to get my connectivity back!!). = ;=20 This sort of thing could just as easily happen with a leased line though, s= o I'm=20 not really sure I buy that the leased line is really more reliable than DSL= line=20 from a high quality ISP.  Although maybe a particular SLA makes i= t so=20 in some legal sense since you can then sue someone.  Personally, if yo= ur=20 leased line really costs more than the DSL, I'd get rid of it and get a 2nd= DSL=20 line from another provider and use that as your backup instead.
 
Anyway, I guess my main point is= that the=20 high cost of your leased line might be clouding your thinking on this. = ; I=20 wouldn't let the comparitive cost be your guiding light here.  Go= with=20 what makes sense from a technology perspective, and don't guilt yourself in= to=20 trying to get full utilization out of the slow link just because it costs= =20 more.
 
----- Original Message -----
From:=20 Kenneth Kalmer
To: lartc
Sent: Saturday, April 23, 2005 4:3= 4=20 PM
Subject: [LARTC] Spill over

List

I need some help, advice or just a starting po= int=20 on the following situation:

Link A - 64kbps leased line
Link B = -=20 512kbps ADSL line

Is it possible to have Link A saturated constant= ly=20 and have the excess traffic "spill over" onto Link B? I know it= 's possible to=20 have packets sent down links in a round-robin fashion and I've read in th= e=20 howto on load sharing over multiple interfaces (http://lartc.org/howto/lartc.loadshare.html<= /a> ),=20 but I do not have control over the termination of the link at the ISP's (= two=20 different one as well). Also note that splitting different protocols over= each=20 of these links are not possible in our case.

Reason being, Link A = is a=20 more reliable and more expensive link, so I need to over-use it's capacit= y if=20 it we're, and use the cheaper ADSL (link B) offering to keep al services= =20 running when the leased line (A) is saturated.

Any tips, suggestio= ns=20 and comments would be welcomed.

Regards

--

Kenneth= =20 Kalmer
kenneth.kalmer@gmai= l.com
http://opensourcery.blogspot.com=20


_______________________________________________
LARTC mailing= =20 list
LARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc


_______________________________________________
LARTC mailing listLARTC@mailman.ds9a.nl
http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc





--

Kenneth Kalmer
kenneth.kalmer@gmail.com
http://opensourcery.blogspot.com ------=_Part_5360_21792979.1114415300859-- --===============0919614172== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc --===============0919614172==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Taylor, Grant" Date: Mon, 25 Apr 2005 15:43:19 +0000 Subject: Re: [LARTC] Spill over Message-Id: <426D1017.2030109@riverviewtech.net> List-Id: References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: lartc@vger.kernel.org Kenneth Kalmer wrote: > Taylor & Chris (and the list) > > The arguments behind my choice here is cost driven, the 64kbps line is a > fixed monthly rate for unlimited use, the 512kbps line costs us roughly > ZAR250 per 3GB of usage. This can get quite expensive as the lines in > question is for a college and we all know what students do to bandwidth :) > > Taken the amount we pay every month for the 64kbps line it's more > economical to over utilize the link as a primary connection than to have > it lying around as a backup. South Africa and data connections don't go > well in the same sentence... > > As Chris suggested, I need something that can detect when Link A is > saturated and then redirect the traffic over Link B until there is > available bandwidth on Link A again. The rate limit trick of Taylor > might work once I get to understand the usage patterns of these > students. But for at least the first 3 months I won't have proper data > at my disposal. > > Thanks for your replies! Seeing as you are trying to avoid excessive bandwidth charges you find you self in a rather interesting position. Aside form what ever you end up using to control what route your traffic goes out you will ultimately want to have a fairly tight set up on what type of traffic is allowed. I have a client here in my town that managed to saturate an ADSL connection in the first 72 hours that we had the network in a testing state before we even went live with it. Ultimately we had to keep the traffic under 20 GB worth every month or they incurred extra charges. To this end I ended up setting up the router to only allow outbound traffic if it was destined to the following ports: (20) 21, 22, 23, 25, 53, 80, 110, 119, 143, and 443. I told the client that we would run with that set up until they told me that they needed another port opened for any given reason. I took the mentality of everything else will be shut down unless you can give me a reasonable request that is backed by someone with political authority (House monitor, Board Members, etc) that says that it is ok for you to be using this type of traffic. After I did this things have been GREAT. We have not had any more problems save for the month that they did not pay the ISP. The real problem that I see in trying to keep one link saturated is that you can control the outbound traffic but you have no way to control the inbound traffic. Well there are ways that you can attempt to control the inbound traffic but they are more a responsive control method (which is less likely to succeed) than a proactive control method like you can do if you control the sending end of the connection. A really drastic idea that I have that might not be too hard to implement would be to establish a PPP multilink session out both connections to a server somewhere on the internet that has HIGH bandwidth (more than your aggregate bandwidth). What this will allow you to do is control what link the traffic will come in and out. All your traffic would appear to be coming from the IP of the server out on the net but I don't see that as a problem really. I think if you do this you can set up routing and traffic control to try to use the 64 kbps link as the primary link and role over to the 512 kbps ASDL link if the first is saturated. I'm not sure how to go about doing this as this would be either in side of the PPP set up or some other complex method. You cold have traffic split across both links too as you control both ends and can reassemble it the way that it needs to be before it is sent out to the world or in to your LAN. One really nasty what that I could think to make this work would be to set up a default gateway to the IP of the ISP side of the 64 kbps link with a metric of 1 and a default gateway to the IP of the ISP side of the 512 kbps link with a metric of 2. You would need to watch the rate of traffic flowing out the 64 kbps link and any traffic that would be over it you would need to reject with no route to host which would cause your router to choose the other default route out, in this case the 512 kbps link. One MAJOR draw back to this that I see is that you would need / want to flush your routing cache fairly often, at least once per minute to make sure that your router would not end up learning that the 64 kbps link had problems and thus start using the 512 kbps link as a de-fac-to standard by remembering that the 64 kbps link did not have a route to any specific host. Something else that you should consider is that the subnets directly on the other side of each respective link have the best route to them of that said link vs going out the other link and hopping around on the internet to get back in to the first links IPSs network. Why take the long way around the building around the back to get from one front corner to the other? This is the type of paradigm that you will be creating. If this is not an issue you can disregard this statement. Needless to say there are a lot of issues involved here. This is not just a simple here you go type of thing. Grant. . . . _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Chris Bennett" Date: Mon, 25 Apr 2005 21:56:26 +0000 Subject: Re: [LARTC] Spill over Message-Id: <001501c549e1$a0b59090$200fa8c0@DELTA> MIME-Version: 1 Content-Type: multipart/mixed; boundary="===============1876831682==" List-Id: References: In-Reply-To: To: lartc@vger.kernel.org This is a multi-part message in MIME format. --===============1876831682== Content-Type: multipart/alternative; boundary="----=_NextPart_000_0012_01C549B7.B7D130B0" This is a multi-part message in MIME format. ------=_NextPart_000_0012_01C549B7.B7D130B0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable A little googling tells me 250 ZAR ~ 42 USD. Is this correct? If so, = ouch.. that's pricey. 3GB (assuming B in this case is BYTE) comes out to about 9kbit / second = over a month, if I did my math correctly. Ouch again. Does the 3GB apply to the total of up and down traffic, or just down? = Because you can't control traffic coming to you very well. You can try = to control TCP traffic with policing, but UDP traffic does its own = thing. Not to mention jokers who decide to flood the link for the hell = of it. Given this new info, it sounds more like you shouldn't try to use the = 512kbit link at all unless the 64kbit link goes down. If you do try to = push "excess" traffic onto it, all that does is encourage the use of = applications that will consume the entire bandwidth available. If that = is really beyond your budget, it doesn't seem like something you'd want = to do. Better to set the expectations at 64kbit so the users don't get = the idea of tuning into Internet radio or something. In fact, if the = 64kbit link does go down, it could be a good idea to police the 512kbit = link down to 64kbit, just so the users don't jump for joy when the = 64kbit link goes down... (keeping in mind that policing is no guarantee = that you'll actually stay below 64kbit usage, especially if a lot of the = traffic is UDP). ----- Original Message -----=20 From: Kenneth Kalmer=20 To: Chris Bennett ; Taylor Grant=20 Cc: lartc=20 Sent: Monday, April 25, 2005 2:48 AM Subject: Re: [LARTC] Spill over Taylor & Chris (and the list) The arguments behind my choice here is cost driven, the 64kbps line is = a fixed monthly rate for unlimited use, the 512kbps line costs us = roughly ZAR250 per 3GB of usage. This can get quite expensive as the = lines in question is for a college and we all know what students do to = bandwidth :) Taken the amount we pay every month for the 64kbps line it's more = economical to over utilize the link as a primary connection than to have = it lying around as a backup. South Africa and data connections don't go = well in the same sentence... As Chris suggested, I need something that can detect when Link A is = saturated and then redirect the traffic over Link B until there is = available bandwidth on Link A again. The rate limit trick of Taylor = might work once I get to understand the usage patterns of these = students. But for at least the first 3 months I won't have proper data = at my disposal. Thanks for your replies! ------=_NextPart_000_0012_01C549B7.B7D130B0 Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
A little googling tells me 250 = ZAR ~=20 42 USD.  Is this correct?  If so, ouch.. that's = pricey.
 
3GB (assuming B in this case is = BYTE) comes=20 out to about 9kbit / second over a month, if I did my math=20 correctly.  Ouch again.
 
Does the 3GB apply to the total = of up and=20 down traffic, or just down?  Because you can't control traffic = coming to=20 you very well.  You can try to control TCP traffic with policing, = but UDP=20 traffic does its own thing.  Not to mention jokers who decide to = flood the=20 link for the hell of it.
 
Given this new info, it sounds = more like=20 you shouldn't try to use the 512kbit link at all unless the 64kbit link = goes=20 down.  If you do try to push "excess" traffic onto it, all = that does=20 is encourage the use of applications that will consume the entire = bandwidth=20 available.  If that is really beyond your budget, it = doesn't seem=20 like something you'd want to do.  Better to set the expectations at = 64kbit=20 so the users don't get the idea of tuning into Internet radio = or=20 something.  In fact, if the 64kbit link does go down, it could be a = good=20 idea to police the 512kbit link down to 64kbit, just so the users = don't=20 jump for joy when the 64kbit link goes down... (keeping in mind that = policing is=20 no guarantee that you'll actually stay below 64kbit usage, especially if = a lot=20 of the traffic is UDP).
----- Original Message -----
From:=20 Kenneth Kalmer
To: Chris Bennett ; Taylor=20 Grant
Cc: lartc
Sent: Monday, April 25, 2005 = 2:48=20 AM
Subject: Re: [LARTC] Spill = over

Taylor &=20 Chris (and the list)

The arguments behind my choice here is = cost=20 driven, the 64kbps line is a fixed monthly rate for unlimited use, the = 512kbps=20 line costs us roughly ZAR250 per 3GB of usage. This can get quite = expensive as=20 the lines in question is for a college and we all know what students = do to=20 bandwidth :)

Taken the amount we pay every month for the 64kbps = line=20 it's more economical to over utilize the link as a primary connection = than to=20 have it lying around as a backup. South Africa and data connections = don't go=20 well in the same sentence...

As Chris suggested, I need = something that=20 can detect when Link A is saturated and then redirect the traffic over = Link B=20 until there is available bandwidth on Link A again. The rate limit = trick of=20 Taylor might work once I get to understand the usage patterns of these = students. But for at least the first 3 months I won't have proper data = at my=20 disposal.

Thanks for your = replies!
------=_NextPart_000_0012_01C549B7.B7D130B0-- --===============1876831682== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc --===============1876831682==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: Kenneth Kalmer Date: Wed, 04 May 2005 11:11:25 +0000 Subject: Re: [LARTC] Spill over Message-Id: List-Id: References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: lartc@vger.kernel.org Chris, Taylor and the list Sorry for the late reply, had a much needed holiday and did some research on the topic. I'm willing to test Taylor's suggestion using some ugly route hacking to balance traffic over the links but I need an application that I can call to get the current throughput on any link, then match this with the links known max and then working on the 95th percentile start changing routes to try and keep each link maxed at around 95%. I know this will not be easy to achieve, but if nothing else it will be a great learning experience. Another thing I stumbled upon is the TEQL scheduling algorithm, http://www.docum.org/docum.org/docs/kernel/teql.php, and it seems to do just what I need. Considering all my connections (except the 64kbps) is PPP connections I can easily use ip-down and ip-up to enslave,deslave devices from the qdisc that does the traffic. I can also easily adjust all the iptables rules from here as well to make sure the source natting is correct. I also understand that in this situation I need to turn off return path filtering in the kernel to avoid the kernel rejecting the packets as martian packets, or is this only the case when I have control over both ends of the link and do channel trunking? Another project that came up is balance, http://balance.sourceforge.net, but this is only a TCP proxy that performs round-robin loads balancing with failover. BalanceNG, the commercial version does have weighted averages and least-used paths and I don't know what else. A few commercial alternatives, one from Sangoma called Wanpipe uses the TEQL as it's backed and it only provides the fail-over and alternative configurations and monitoring IIRC. In reply to Chris, yes, South African bandwidth prices has long been a topic that brings fear into the heart of the average South African. Read more on http://www.hellkom.com.co.za, I have nothing to do with this site but they do tell it like it is... Also, all the users are already shaped behind the box so they won't know when they are using the faster links. We don't only have these two connections, we have plenty more including wireless links with seperate providers, multiple ADSL and leased line combinations. The 64kbps and 512kbps where only examples, but thanks, I appreciate your opinions on this! As usual, any comments, suggestions, even insults are welcomed and appreciated! On 4/25/05, Chris Bennett wrote: > > A little googling tells me 250 ZAR ~ 42 USD. Is this correct? If so, ouch.. that's pricey. > > 3GB (assuming B in this case is BYTE) comes out to about 9kbit / second over a month, if I did my math correctly. Ouch again. > > Does the 3GB apply to the total of up and down traffic, or just down? Because you can't control traffic coming to you very well. You can try to control TCP traffic with policing, but UDP traffic does its own thing. Not to mention jokers who decide to flood the link for the hell of it. > > Given this new info, it sounds more like you shouldn't try to use the 512kbit link at all unless the 64kbit link goes down. If you do try to push "excess" traffic onto it, all that does is encourage the use of applications that will consume the entire bandwidth available. If that is really beyond your budget, it doesn't seem like something you'd want to do. Better to set the expectations at 64kbit so the users don't get the idea of tuning into Internet radio or something. In fact, if the 64kbit link does go down, it could be a good idea to police the 512kbit link down to 64kbit, just so the users don't jump for joy when the 64kbit link goes down... (keeping in mind that policing is no guarantee that you'll actually stay below 64kbit usage, especially if a lot of the traffic is UDP). > > ----- Original Message ----- > From: Kenneth Kalmer > To: Chris Bennett ; Taylor Grant > Cc: lartc > Sent: Monday, April 25, 2005 2:48 AM > Subject: Re: [LARTC] Spill over > > Taylor & Chris (and the list) > > The arguments behind my choice here is cost driven, the 64kbps line is a fixed monthly rate for unlimited use, the 512kbps line costs us roughly ZAR250 per 3GB of usage. This can get quite expensive as the lines in question is for a college and we all know what students do to bandwidth :) > > Taken the amount we pay every month for the 64kbps line it's more economical to over utilize the link as a primary connection than to have it lying around as a backup. South Africa and data connections don't go well in the same sentence... > > As Chris suggested, I need something that can detect when Link A is saturated and then redirect the traffic over Link B until there is available bandwidth on Link A again. The rate limit trick of Taylor might work once I get to understand the usage patterns of these students. But for at least the first 3 months I won't have proper data at my disposal. > > Thanks for your replies! > > _______________________________________________ > LARTC mailing list > LARTC@mailman.ds9a.nl > http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc > > > -- Kenneth Kalmer kenneth.kalmer@gmail.com http://opensourcery.blogspot.com _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc From mboxrd@z Thu Jan 1 00:00:00 1970 From: Kenneth Kalmer Date: Wed, 04 May 2005 21:12:51 +0000 Subject: Re: [LARTC] Spill over Message-Id: List-Id: References: In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: lartc@vger.kernel.org Chris, Taylor and the list Sorry for the late reply, had a much needed holiday and did some research on the topic. I'm willing to test Taylor's suggestion using some ugly route hacking to balance traffic over the links but I need an application that I can call to get the current throughput on any link, then match this with the links known max and then working on the 95th percentile start changing routes to try and keep each link maxed at around 95%. I know this will not be easy to achieve, but if nothing else it will be a great learning experience. Another thing I stumbled upon is the TEQL scheduling algorithm, http://www.docum.org/docum.org/docs/kernel/teql.php, and it seems to do just what I need. Considering all my connections (except the 64kbps) is PPP connections I can easily use ip-down and ip-up to enslave,deslave devices from the qdisc that does the traffic. I can also easily adjust all the iptables rules from here as well to make sure the source natting is correct. I also understand that in this situation I need to turn off return path filtering in the kernel to avoid the kernel rejecting the packets as martian packets, or is this only the case when I have control over both ends of the link and do channel trunking? Another project that came up is balance, http://balance.sourceforge.net, but this is only a TCP proxy that performs round-robin loads balancing with failover. BalanceNG, the commercial version does have weighted averages and least-used paths and I don't know what else. A few commercial alternatives, one from Sangoma called Wanpipe uses the TEQL as it's backed and it only provides the fail-over and alternative configurations and monitoring IIRC. In reply to Chris, yes, South African bandwidth prices has long been a topic that brings fear into the heart of the average South African. Read more on http://www.hellkom.com.co.za, I have nothing to do with this site but they do tell it like it is... Also, all the users are already shaped behind the box so they won't know when they are using the faster links. We don't only have these two connections, we have plenty more including wireless links with seperate providers, multiple ADSL and leased line combinations. The 64kbps and 512kbps where only examples, but thanks, I appreciate your opinions on this! As usual, any comments, suggestions, even insults are welcomed and appreciated! On 4/25/05, Chris Bennett wrote: > > A little googling tells me 250 ZAR ~ 42 USD. Is this correct? If so, ouch.. that's pricey. > > 3GB (assuming B in this case is BYTE) comes out to about 9kbit / second over a month, if I did my math correctly. Ouch again. > > Does the 3GB apply to the total of up and down traffic, or just down? Because you can't control traffic coming to you very well. You can try to control TCP traffic with policing, but UDP traffic does its own thing. Not to mention jokers who decide to flood the link for the hell of it. > > Given this new info, it sounds more like you shouldn't try to use the 512kbit link at all unless the 64kbit link goes down. If you do try to push "excess" traffic onto it, all that does is encourage the use of applications that will consume the entire bandwidth available. If that is really beyond your budget, it doesn't seem like something you'd want to do. Better to set the expectations at 64kbit so the users don't get the idea of tuning into Internet radio or something. In fact, if the 64kbit link does go down, it could be a good idea to police the 512kbit link down to 64kbit, just so the users don't jump for joy when the 64kbit link goes down... (keeping in mind that policing is no guarantee that you'll actually stay below 64kbit usage, especially if a lot of the traffic is UDP). > > ----- Original Message ----- > From: Kenneth Kalmer > To: Chris Bennett ; Taylor Grant > Cc: lartc > Sent: Monday, April 25, 2005 2:48 AM > Subject: Re: [LARTC] Spill over > > Taylor & Chris (and the list) > > The arguments behind my choice here is cost driven, the 64kbps line is a fixed monthly rate for unlimited use, the 512kbps line costs us roughly ZAR250 per 3GB of usage. This can get quite expensive as the lines in question is for a college and we all know what students do to bandwidth :) > > Taken the amount we pay every month for the 64kbps line it's more economical to over utilize the link as a primary connection than to have it lying around as a backup. South Africa and data connections don't go well in the same sentence... > > As Chris suggested, I need something that can detect when Link A is saturated and then redirect the traffic over Link B until there is available bandwidth on Link A again. The rate limit trick of Taylor might work once I get to understand the usage patterns of these students. But for at least the first 3 months I won't have proper data at my disposal. > > Thanks for your replies! > > _______________________________________________ > LARTC mailing list > LARTC@mailman.ds9a.nl > http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc > > > -- Kenneth Kalmer kenneth.kalmer@gmail.com http://opensourcery.blogspot.com _______________________________________________ LARTC mailing list LARTC@mailman.ds9a.nl http://mailman.ds9a.nl/cgi-bin/mailman/listinfo/lartc