From mboxrd@z Thu Jan 1 00:00:00 1970 From: Eric Dumazet Subject: Re: hackbench regression due to commit 9dfc6e68bfe6e Date: Thu, 08 Apr 2010 17:52:19 +0200 Message-ID: <1270741939.2215.68.camel@edumazet-laptop> References: <1270705153.8141.58.camel@edumazet-laptop> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: QUOTED-PRINTABLE Cc: "Zhang, Yanmin" , Pekka Enberg , netdev , Tejun Heo , alex.shi@intel.com, "linux-kernel@vger.kernel.org" , "Ma, Ling" , "Chen, Tim C" , Andrew Morton To: Christoph Lameter Return-path: Received: from mail-bw0-f209.google.com ([209.85.218.209]:63288 "EHLO mail-bw0-f209.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S932763Ab0DHPwZ (ORCPT ); Thu, 8 Apr 2010 11:52:25 -0400 In-Reply-To: Sender: netdev-owner@vger.kernel.org List-ID: Le jeudi 08 avril 2010 =C3=A0 10:34 -0500, Christoph Lameter a =C3=A9cr= it : > On Thu, 8 Apr 2010, Eric Dumazet wrote: >=20 > > I suspect NUMA is completely out of order on current kernel, or my > > Nehalem machine NUMA support is a joke > > > > # numactl --hardware > > available: 2 nodes (0-1) > > node 0 size: 3071 MB > > node 0 free: 2637 MB > > node 1 size: 3062 MB > > node 1 free: 2909 MB >=20 > How do the cpus map to the nodes? cpu 0 and 1 both on the same node? one socket maps to 0 2 4 6 8 10 12 14 (Node 0) one socket maps to 1 3 5 7 9 11 13 15 (Node 1) # numactl --cpubind=3D0 --membind=3D0 numactl --show policy: bind preferred node: 0 interleavemask:=20 interleavenode: 0 nodebind: 0=20 membind: 0=20 cpubind: 1 3 5 7 9 11 13 15 1024=20 (strange 1024 report...) # numactl --cpubind=3D1 --membind=3D1 numactl --show policy: bind preferred node: 1 interleavemask:=20 interleavenode: 0 nodebind:=20 membind: 1=20 cpubind: 0 2 4 6 8 10 12 14=20 [ 0.161170] Booting Node 0, Processors #1 [ 0.248995] CPU 1 MCA banks CMCI:2 CMCI:3 CMCI:5 CMCI:6 SHD:8 [ 0.269177] Ok. [ 0.269453] Booting Node 1, Processors #2 [ 0.356965] CPU 2 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8 [ 0.377207] Ok. [ 0.377485] Booting Node 0, Processors #3 [ 0.464935] CPU 3 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8 [ 0.485065] Ok. [ 0.485217] Booting Node 1, Processors #4 [ 0.572906] CPU 4 MCA banks CMCI:2 CMCI:3 CMCI:5 SHD:6 SHD:8 [ 0.593044] Ok. =2E.. grep "physical id" /proc/cpuinfo=20 physical id : 1 physical id : 0 physical id : 1 physical id : 0 physical id : 1 physical id : 0 physical id : 1 physical id : 0 physical id : 1 physical id : 0 physical id : 1 physical id : 0 physical id : 1 physical id : 0 physical id : 1 physical id : 0