From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jesse Barnes Subject: Re: Receive side performance issue with multi-10-GigE and NUMA Date: Wed, 12 Aug 2009 09:00:59 -0700 Message-ID: <20090812090059.72725877@jbarnes-g45> References: <20090807170600.9a2eff2e.billfink@mindspring.com> <4A7C9A14.7070600@inria.fr> <20090807175112.a1f57407.billfink@mindspring.com> <4A7CCEFC.7020308@myri.com> <20090807213557.d0faec23.billfink@mindspring.com> <4A7D5CA4.3030307@myri.com> <20090808112636.GB18518@localhost.localdomain> <4A7DC230.6060206@myri.com> <20090808183251.GA23300@localhost.localdomain> <20090811033210.6b422ed1.billfink@mindspring.com> <20090812003824.26c9c8fb.billfink@mindspring.com> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: "Brandeburg, Jesse" , Neil Horman , Andrew Gallatin , Brice Goglin , Linux Network Developers , Yinghai Lu To: Bill Fink Return-path: Received: from outbound-mail-122.bluehost.com ([67.222.38.22]:56636 "HELO outbound-mail-122.bluehost.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with SMTP id S1754082AbZHLQBA (ORCPT ); Wed, 12 Aug 2009 12:01:00 -0400 In-Reply-To: <20090812003824.26c9c8fb.billfink@mindspring.com> Sender: netdev-owner@vger.kernel.org List-ID: On Wed, 12 Aug 2009 00:38:24 -0400 Bill Fink wrote: > On Tue, 11 Aug 2009, Brandeburg, Jesse wrote: > > > Bill Fink wrote: > > > On Sat, 8 Aug 2009, Neil Horman wrote: > > > > > >> On Sat, Aug 08, 2009 at 02:21:36PM -0400, Andrew Gallatin wrote: > > >>> Neil Horman wrote: > > >>>> On Sat, Aug 08, 2009 at 07:08:20AM -0400, Andrew Gallatin > > >>>> wrote: > > >>>>> Bill Fink wrote: > > >>>>>> On Fri, 07 Aug 2009, Andrew Gallatin wrote: > > >>>>>> > > >>>>>>> Bill Fink wrote: > > >>>>>>> > > >>>>>>>> All sysfs local_cpus values are the same > > >>>>>>>> (00000000,000000ff), so yes they are also wrong. > > > > bill, I recently helped Jesse Barnes push a patch that addresses > > this kind of issue on CoreI7, the root cause was the numa_node > > variable was initialized based on slot on AMD systems, but needed > > to be set to -1 by default on systems with a uniform IOH to slot > > architecture. > > > > here is the commit ID: > > http://git.kernel.org/?p=linux/kernel/git/sfr/linux-next.git;a=commit;h=3c38 > > d674be519109696746192943a6d524019f7f > > > > I'm not sure it is in linus' tree yet, this link is to net-next > > > > Maybe see if it helps? > > It's worth a shot. > > Hopefully I can get a chance to build a new kernel tomorrow to check > out some of the suggestions, like this one, the setting of ACPI_DEBUG, > and the new ftrace module for checking NUMA affinity of skbs. It's a fairly significant change so I wasn't planning on sending it to Linus for 2.6.31. If you think it *should* go into 2.6.31 (and stable for that matter), please let me know soon. Thanks, -- Jesse Barnes, Intel Open Source Technology Center