From mboxrd@z Thu Jan 1 00:00:00 1970 From: Arkadiusz =?utf-8?q?Mi=C5=9Bkiewicz?= Subject: forcedeth doesn't pass traffic (3.0.x kernel and earliers) Date: Sat, 10 Dec 2011 22:26:31 +0100 Message-ID: <201112102226.31546.a.miskiewicz@gmail.com> Mime-Version: 1.0 Content-Type: Text/Plain; charset=utf-8 Content-Transfer-Encoding: QUOTED-PRINTABLE Cc: Ian Campbell , David Decotigny , Eric Dumazet To: netdev@vger.kernel.org Return-path: Received: from mail-ee0-f46.google.com ([74.125.83.46]:38336 "EHLO mail-ee0-f46.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751416Ab1LJV0g convert rfc822-to-8bit (ORCPT ); Sat, 10 Dec 2011 16:26:36 -0500 Received: by eekc4 with SMTP id c4so932015eek.19 for ; Sat, 10 Dec 2011 13:26:35 -0800 (PST) Sender: netdev-owner@vger.kernel.org List-ID: Hello, I have few supermicro machines connected to edge-core switch using 1Gbp= s uplink. The problem is that after boot I have to restart net to get network car= d pass traffic. The problem is only with forcedeth network cards. It happens on different supermicr= o servers and it happens for as far as I can remember (so, 2.6.3x kernels, too). Currently I'm o= n 3.0.13. Logs below show state after fresh boot where network traffic doesn't ge= t through. Note that it shows that link is up but still - traffic doesn't get pass= ed. tcpdump on eth0 interface sees only traffic initiated from this server and no traffic f= rom outside. Tried to set every offload (via ethtool -K) to off but that didn't help= =2E I have to make: ip link set eth0 down; ip link set eth0 up wait few second and then traffic starts to get passed. When I do that t= his shows in dmesg: [ 1058.266480] forcedeth 0000:00:08.0: irq 40 for MSI/MSI-X [ 1069.163238] eth0: no IPv6 routers present (CC to few people shown by get_maintainer.pl) LOGS/OUTPUTs from non working state after fresh boot. # dmesg|grep eth [ 34.528326] forcedeth: Reverse Engineered nForce ethernet driver. Ve= rsion 0.64. [ 34.528542] forcedeth 0000:00:08.0: PCI INT A -> Link[LMAC] -> GSI 2= 2 (level, low) -> IRQ 22 [ 34.528547] forcedeth 0000:00:08.0: setting latency timer to 64 [ 35.055319] forcedeth 0000:00:08.0: ifname eth0, PHY OUI 0x5043 @ 2,= addr 00:30:48:7a:b4:88 [ 35.055324] forcedeth 0000:00:08.0: highdma csum vlan pwrctl mgmt gb= it lnktim msi desc-v3 [ 35.056480] forcedeth 0000:00:09.0: PCI INT A -> Link[LMAD] -> GSI 2= 1 (level, low) -> IRQ 21 [ 35.056485] forcedeth 0000:00:09.0: setting latency timer to 64 [ 35.581960] forcedeth 0000:00:09.0: ifname eth1, PHY OUI 0x5043 @ 3,= addr 00:30:48:7a:b4:89 [ 35.581965] forcedeth 0000:00:09.0: highdma csum vlan pwrctl mgmt gb= it lnktim msi desc-v3 [ 35.584211] Loading kernel module for a network device with CAP_SYS_= MODULE (deprecated). Use CAP_NET_ADMIN and alias netdev-eth0 instead [ 35.591778] forcedeth 0000:00:08.0: irq 40 for MSI/MSI-X [ 35.591970] forcedeth 0000:00:08.0: eth0: no link during initializat= ion [ 35.593030] ADDRCONF(NETDEV_UP): eth0: link is not ready [ 37.666757] forcedeth 0000:00:08.0: eth0: link up [ 37.668624] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 48.150006] eth0: no IPv6 routers present lspci -vv: 00:09.0 Bridge: nVidia Corporation MCP55 Ethernet (rev a3) Subsystem: Super Micro Computer Inc Device 1611 Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- Par= Err- Stepping- SERR- FastB2B- DisINTx- Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=3Dfast >TAbort= - SERR- mtu 1500 qdisc sfq state UP = qlen 1000 link/ether 00:30:48:7a:b4:88 brd ff:ff:ff:ff:ff:ff --=20 Arkadiusz Mi=C5=9Bkiewicz PLD/Linux Team arekm / maven.pl http://ftp.pld-linux.org/