[Bridge] Re: tg3 bridge problems

[Gergely Madarasz <gorgo@broadband.hu>]

On Mon, Jan 10, 2005 at 10:05:56AM -0500, Neil Horman wrote:
> Gergely Madarasz wrote:
> >Hello,
> >
> >I've got a very strange problem. Lately I've been setting up my linux
> >servers for network (layer2) redundancy with a bridge interface containing
> >two ethernet interfaces connecting to two switches. So far I didn't have
> >any problems with it, but now a very strange thing happens with a new
> >server I'm installing. The server is an ibm x346 having two onboard
> >BCM5721 cards, the switches are cisco 3550, and I've tested with kernel
> >versions 2.6.10 and 2.4.28.
> >
> >The bpdu's from the cisco switches simply cannot be seen on the server,
> >causing loops in l2 traffic. I've tested with sticking a hub between the
> >c3550 and the server, the switch sends out the bpdu's, but they are not
> >seen by linux (running tethereal). This happens only on eth0, on eth1
> >everything seems fine. Any IP traffic on eth0 goes through, no packet
> >loss, no errors.
> >
> >And something even more strange: if I do an 
> >ifconfig eth0 0 up; brctl addif br0 eth0; 
> >it seems to be working fine, if I do it the other way
> >round, then the bpdu's sent by the switches are lost somewhere.
> >
> >Considering all these, the problem seems to me a strange interaction
> >between the bridge driver, the tg3 driver and the hardware in question. 
>
> It looks to me like either order should work just fine, as long as the 
> IFF_PROMISC flag isn't cleared when you bring up the interface.  Is 
> IF_PROMISC clear in ifconfig after you issue your ifconfig eth0 up command?

ifconfig has never showed PROMISC on either of my bridged servers. 
ip shows it though. I noticed this before but couldn't find the reason and
didn't seem important.

This is on a machine with working bridge:

# ifconfig eth0
eth0      Link encap:Ethernet  HWaddr 00:09:6B:49:89:80
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          ...
# ip link list eth0
2: eth0: <BROADCAST,MULTICAST,PROMISC,UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 00:09:6b:49:89:80 brd ff:ff:ff:ff:ff:ff

And this is on the problematic machine:

# ifconfig eth0
eth0      Link encap:Ethernet  HWaddr 00:0D:60:55:3B:02
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          ....
# ip addr list eth0
2: eth0: <BROADCAST,MULTICAST,PROMISC,UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 00:0d:60:55:3b:02 brd ff:ff:ff:ff:ff:ff

And even if didn't get promisc, tcpdump or tethereal would have made it
so, when I was looking for the bpdu packets. Tethereal shows only this:

  0.000000 00:0d:60:55:3b:02 -> 01:80:c2:00:00:00 STP Conf. Root = 65535/00:0d:60:55:3b:02  Cost = 0  Port = 0x8001

Greg