From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ben Greear Subject: Re: ixgbe and mac-vlans problem Date: Fri, 30 Apr 2010 15:20:22 -0700 Message-ID: <4BDB57A6.1090400@candelatech.com> References: <4BDA07DB.8020206@candelatech.com> <201004302000.58763.arnd@arndb.de> <4BDB1CF3.8030906@candelatech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Arnd Bergmann , NetDev , Patrick McHardy To: "Tantilov, Emil S" Return-path: Received: from mail.candelatech.com ([208.74.158.172]:39956 "EHLO ns3.lanforge.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1756600Ab0D3WU3 (ORCPT ); Fri, 30 Apr 2010 18:20:29 -0400 In-Reply-To: Sender: netdev-owner@vger.kernel.org List-ID: On 04/30/2010 02:13 PM, Tantilov, Emil S wrote: > Ben Greear wrote: >> On 04/30/2010 11:00 AM, Arnd Bergmann wrote: >>> On Friday 30 April 2010 00:27:39 Ben Greear wrote: >>>> Basically, we create 50 mac-vlans, with sequential MAC addresses >>>> and sequential IP addresses, and set up ip rules properly. >>>> >>>> The issue is that only 10 or so of the mac-vlans receive other than >>>> broadcast packets. The ixgbe NIC doesn't show PROMISC mode. >>> >>> I just took a brief look at the driver and noticed that 82599 should >>> be able to handle 128 entries before going into promisc mode, while >>> 82598 (the same driver) does 16. >>> >>> Maybe the logic for>16 entries is wrong, so you could try forcing >>> hw->mac.num_rar_entries to 16 for 82599 as well. >> >> I think I was actually on an 825998 system when I saw it yesterday, >> but I have seen similar issues on 82599, though I didn't take time >> to debug it fully, so it could have been something else. >> >> I will double-check the NIC chipset on the system that showed the >> problem yesterday. > > I ran a quick test in my setup with 82599 and was able to pass traffic > on all 50 mac-vlans without issues. This is on net-next. For an 82599 system, I can get 127 mac-vlans working out of 500 created. That NIC also does not go PROMISC with lots (500) of mac-vlans. Once I put it in promisc mode manually, it works fine. So, I think whatever logic is supposed to put the NIC into promisc mode when it overflows it's lookup tables isn't working for ixgbe in 2.6.31.12. Thanks, Ben > > Thanks, > Emil -- Ben Greear Candela Technologies Inc http://www.candelatech.com