* bonding-devel mail list? @ 2019-05-23 15:31 Bill Carlson 2019-05-23 16:46 ` Jay Vosburgh 0 siblings, 1 reply; 5+ messages in thread From: Bill Carlson @ 2019-05-23 15:31 UTC (permalink / raw) To: netdev@vger.kernel.org Hello, Noted the old bonding-devel mail list at sourceforge is no more, is there an alternate? Chasing whether a bond of bonds has an issue my testing hasn't revealed. Thanks, -- Bill Carlson Anything is possible, given Time and Money. ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: bonding-devel mail list? 2019-05-23 15:31 bonding-devel mail list? Bill Carlson @ 2019-05-23 16:46 ` Jay Vosburgh 2019-05-23 20:06 ` Bill Carlson 0 siblings, 1 reply; 5+ messages in thread From: Jay Vosburgh @ 2019-05-23 16:46 UTC (permalink / raw) To: billcarlson; +Cc: netdev@vger.kernel.org Bill Carlson <billcarlson@wkks.org> wrote: >Noted the old bonding-devel mail list at sourceforge is no more, is there >an alternate? Use this list (netdev). Some time ago, I put a parking message on the bonding-devel list redirecting people to netdev, but it appears that sourceforge deleted the mailing list entirely at some point. >Chasing whether a bond of bonds has an issue my testing hasn't revealed. As far as I'm aware, nesting bonds has no practical benefit; do you have a use case for doing so? -J --- -Jay Vosburgh, jay.vosburgh@canonical.com ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: bonding-devel mail list? 2019-05-23 16:46 ` Jay Vosburgh @ 2019-05-23 20:06 ` Bill Carlson 2019-05-23 22:31 ` Jay Vosburgh 0 siblings, 1 reply; 5+ messages in thread From: Bill Carlson @ 2019-05-23 20:06 UTC (permalink / raw) To: Jay Vosburgh; +Cc: netdev@vger.kernel.org On 5/23/19 11:46 AM, Jay Vosburgh wrote: > As far as I'm aware, nesting bonds has no practical benefit; do > you have a use case for doing so? > > Use case is very specific, but needed in my situation until some switches are stabilized. Switches A1..Ax provide LACP, 40G. These are unstable, lose link on one or more interfaces or drop completely. A single bond to the A switches was acceptable at first, including when one interface was down for quite a while. Then all A switches dropped. Switches B1..Bx provide no LACP, 10G. These are sitting and connected anyway, already in place for backup. All are on the same layer two, as in any MAC is visible on any switch. Goal is to use A switches primarily, and drop back to B _IF_ A are completely down. As long as one interface is active on A, that will be used. I assume LACP and active-passive can't be used in the same bond, interested to hear if I'm wrong. My setup I achieved: bond0 -> switches B, multiple interfaces, active-passive bond1 -> switches A, multiple interfaces, LACP bond10 -> slaves bond0 and bond1, active-passive Various VLANs are using bond10. Options to bonding: bond0: mode=1 fail_over_mac=none miimon=100 bond1: mode=4 lacp_rate=1 miimon=100 bond10: mode=1 fail_over_mac=1 primary=bond1 updelay=10000 miimon=100 (I should probably change to arp monitoring, I know.) updelay in place because LACP takes a long time to link. Making sure the MACs switched was the key. Network performance tests via iperf3 look good, including when dropping bond1. Unfortunately, target test system was on bond0, as its A switches were down. The only, critical, test I haven't been able to perform is physically dropping A links, can't reach that far. :) -- Bill Carlson Anything is possible, given Time and Money. ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: bonding-devel mail list? 2019-05-23 20:06 ` Bill Carlson @ 2019-05-23 22:31 ` Jay Vosburgh 2019-05-24 12:56 ` Bill Carlson 0 siblings, 1 reply; 5+ messages in thread From: Jay Vosburgh @ 2019-05-23 22:31 UTC (permalink / raw) To: billcarlson; +Cc: netdev@vger.kernel.org Bill Carlson <billcarlson@wkks.org> wrote: >On 5/23/19 11:46 AM, Jay Vosburgh wrote: >> As far as I'm aware, nesting bonds has no practical benefit; do >> you have a use case for doing so? >> >> >Use case is very specific, but needed in my situation until some switches >are stabilized. > >Switches A1..Ax provide LACP, 40G. These are unstable, lose link on one or >more interfaces or drop completely. A single bond to the A switches was >acceptable at first, including when one interface was down for quite a >while. Then all A switches dropped. > >Switches B1..Bx provide no LACP, 10G. These are sitting and connected >anyway, already in place for backup. > >All are on the same layer two, as in any MAC is visible on any switch. > >Goal is to use A switches primarily, and drop back to B _IF_ A are >completely down. As long as one interface is active on A, that will be >used. > >I assume LACP and active-passive can't be used in the same bond, >interested to hear if I'm wrong. Well, yes and no. No, you can't explicitly configure what you describe (in the sense of saying "slave A is LACP, slave B is active-backup"). However, the logic in LACP will attach every slave of the bond to an aggregator. If one or more slaves are connected to a specific LACP peer, they will aggregate together. If any slave is connected to a non-LACP peer, it will aggregate as an "individual" port. When bonding's LACP mode selects the best aggregator to use, "non-individual" (i.e., connected to a LACP peer) ports are preferred, but if no such ports are available, an individual port is selected as the active aggregator. The precise logic is found in the ad_agg_selection_test() function [1]. If what you've got works for you, then that's great, but I suspect it would still work if all of the interfaces were in a single 802.3ad bond without the nesting. -J [1] https://git.kernel.org/pub/scm/linux/kernel/git/davem/net.git/tree/drivers/net/bonding/bond_3ad.c#n1562 >My setup I achieved: > >bond0 -> switches B, multiple interfaces, active-passive >bond1 -> switches A, multiple interfaces, LACP >bond10 -> slaves bond0 and bond1, active-passive >Various VLANs are using bond10. > >Options to bonding: > >bond0: mode=1 fail_over_mac=none miimon=100 >bond1: mode=4 lacp_rate=1 miimon=100 >bond10: mode=1 fail_over_mac=1 primary=bond1 updelay=10000 miimon=100 >(I should probably change to arp monitoring, I know.) > >updelay in place because LACP takes a long time to link. >Making sure the MACs switched was the key. > >Network performance tests via iperf3 look good, including when dropping >bond1. Unfortunately, target test system was on bond0, as its A switches >were down. > >The only, critical, test I haven't been able to perform is physically >dropping A links, can't reach that far. :) > >-- > >Bill Carlson > >Anything is possible, given Time and Money. --- -Jay Vosburgh, jay.vosburgh@canonical.com ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: bonding-devel mail list? 2019-05-23 22:31 ` Jay Vosburgh @ 2019-05-24 12:56 ` Bill Carlson 0 siblings, 0 replies; 5+ messages in thread From: Bill Carlson @ 2019-05-24 12:56 UTC (permalink / raw) To: Jay Vosburgh; +Cc: netdev@vger.kernel.org On 5/23/19 5:31 PM, Jay Vosburgh wrote: > > However, the logic in LACP will attach every slave of the bond > to an aggregator. If one or more slaves are connected to a specific > LACP peer, they will aggregate together. If any slave is connected to a > non-LACP peer, it will aggregate as an "individual" port. > > When bonding's LACP mode selects the best aggregator to use, > "non-individual" (i.e., connected to a LACP peer) ports are preferred, > but if no such ports are available, an individual port is selected as > the active aggregator. The precise logic is found in the > ad_agg_selection_test() function [1]. > > If what you've got works for you, then that's great, but I > suspect it would still work if all of the interfaces were in a single > 802.3ad bond without the nesting. > > -J Ah, hadn't considered LACP mode would accept non-LACP interfaces. I'll chase this. Thanks. ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2019-05-24 12:56 UTC | newest] Thread overview: 5+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2019-05-23 15:31 bonding-devel mail list? Bill Carlson 2019-05-23 16:46 ` Jay Vosburgh 2019-05-23 20:06 ` Bill Carlson 2019-05-23 22:31 ` Jay Vosburgh 2019-05-24 12:56 ` Bill Carlson
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).