From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Cyrus-Session-Id: sloti22d1t05-1372483-1517179362-2-2279012561966845792 X-Sieve: CMU Sieve 3.0 X-Spam-known-sender: no X-Spam-score: 0.0 X-Spam-hits: BAYES_00 -1.9, HEADER_FROM_DIFFERENT_DOMAINS 0.001, RCVD_IN_DNSWL_HI -5, T_RP_MATCHES_RCVD -0.01, LANGUAGES enro, BAYES_USED global, SA_VERSION 3.4.0 X-Spam-source: IP='209.132.180.67', Host='vger.kernel.org', Country='US', FromHeader='com', MailFrom='org', XOriginatingCountry='US' X-Spam-charsets: plain='iso-8859-1' X-Resolved-to: greg@kroah.com X-Delivered-to: greg@kroah.com X-Mail-from: stable-owner@vger.kernel.org ARC-Seal: i=1; a=rsa-sha256; cv=none; d=messagingengine.com; s=arctest; t=1517179361; b=DNxeguw7pqL2MRXpKCe61z3hqGJiAEhrkHSF+EfUdCJdlWu NJPN6XeJ0ohW4WbGnl2WRCAsyPcGWJu2BYRtolZSIvEy51ALZgZdP1CdZCfbUrtv W6WkO9wQ4BgHMtSInpHKCkVt5V2SmUHd8aLGoJNsywf/+Eizex50fsE8zZLgir32 VxMjMw++xoq91dAfzQp1kW+q6vOGFX0vEyChnB7jzyq01beHs+aR2znf5TeTsn/T Km6JuTo+5S2/cmXw03uKQEGyN05DqUa5Gc1SIoj0LvS8S2hpKcMrvr6rJEiD0dWR eKUgnUgKrPJdwpgVIToXmr4iHk9GllWpMDIeQWg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=from:to:cc:subject:date:message-id :references:in-reply-to:content-type:content-transfer-encoding :mime-version:sender:list-id; s=arctest; t=1517179361; bh=wvYsZA BLwULnBbC77QCrV0q6gBwm9GzmqGphl1i2uT4=; b=RlFFbudUh2EosCDUlIJaEa IQ0Cl5tAWU7kchiYLWGxlt/TF1u3eFR84OaY4IRtGTKZRXXBmwBKHy8dwT9z1qGt MFmHvYh8lHY9zgPmWYLSxezCaiepHOiTlq48fKPHsUviAZM1yNoCL+TBltB9L6la pMxSoXAwtBWP7XHT7yCo4YBSbzZ64wRT3myspFmwbdlbV5s7c8PrECvMF9k2B8cM LXP+4WJU0neJ1+Hq1j7GY/J3V1GcewtnnlRefTHDZZz3idigeDgrzeGdBngQIZvb x46p5Npz/iFkn4hGOZbXM4Qq1k+l7o/Ziq66QZxZhUsCosJsbbDsJ7dS6zYkYUUw == ARC-Authentication-Results: i=1; mx1.messagingengine.com; arc=none (no signatures found); dkim=pass (1024-bit rsa key sha256) header.d=microsoft.com header.i=@microsoft.com header.b=aHp31Jcr x-bits=1024 x-keytype=rsa x-algorithm=sha256 x-selector=selector1; dmarc=pass (p=reject,has-list-id=yes,d=none) header.from=microsoft.com; iprev=pass policy.iprev=209.132.180.67 (vger.kernel.org); spf=none smtp.mailfrom=stable-owner@vger.kernel.org smtp.helo=vger.kernel.org; x-aligned-from=fail; x-ptr=pass x-ptr-helo=vger.kernel.org x-ptr-lookup=vger.kernel.org; x-return-mx=pass smtp.domain=vger.kernel.org smtp.result=pass smtp_org.domain=kernel.org smtp_org.result=pass smtp_is_org_domain=no header.domain=microsoft.com header.result=pass header_is_org_domain=yes Authentication-Results: mx1.messagingengine.com; arc=none (no signatures found); dkim=pass (1024-bit rsa key sha256) header.d=microsoft.com header.i=@microsoft.com header.b=aHp31Jcr x-bits=1024 x-keytype=rsa x-algorithm=sha256 x-selector=selector1; dmarc=pass (p=reject,has-list-id=yes,d=none) header.from=microsoft.com; iprev=pass policy.iprev=209.132.180.67 (vger.kernel.org); spf=none smtp.mailfrom=stable-owner@vger.kernel.org smtp.helo=vger.kernel.org; x-aligned-from=fail; x-ptr=pass x-ptr-helo=vger.kernel.org x-ptr-lookup=vger.kernel.org; x-return-mx=pass smtp.domain=vger.kernel.org smtp.result=pass smtp_org.domain=kernel.org smtp_org.result=pass smtp_is_org_domain=no header.domain=microsoft.com header.result=pass header_is_org_domain=yes Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753800AbeA1W3z (ORCPT ); Sun, 28 Jan 2018 17:29:55 -0500 Received: from mail-bn3nam01on0104.outbound.protection.outlook.com ([104.47.33.104]:34771 "EHLO NAM01-BN3-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S932420AbeA1W3u (ORCPT ); Sun, 28 Jan 2018 17:29:50 -0500 From: Sasha Levin To: "linux-kernel@vger.kernel.org" , "stable@vger.kernel.org" CC: Satheesh Rajendran , Balamuruhan S , Arnaldo Carvalho de Melo , Sasha Levin Subject: [PATCH AUTOSEL for 4.4 07/36] perf bench numa: Fixup discontiguous/sparse numa nodes Thread-Topic: [PATCH AUTOSEL for 4.4 07/36] perf bench numa: Fixup discontiguous/sparse numa nodes Thread-Index: AQHTmIdQi24sOVlTqkeZzv0LOs35Lw== Date: Sun, 28 Jan 2018 22:28:26 +0000 Message-ID: <20180128222815.29479-7-alexander.levin@microsoft.com> References: <20180128222815.29479-1-alexander.levin@microsoft.com> In-Reply-To: <20180128222815.29479-1-alexander.levin@microsoft.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [52.168.54.252] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;MW2PR2101MB1115;7:U2F56X4alGF84has0jlw+FjfeVLQFR7MjtfPWoTnfJ3kDJLX5aXdR8eQmf+RrKmtMZZCKgJgrthNOHudLcwSXeTVNDt1lstk7h9fAHayUNeWqB0F2uET8FMJDYby1ackmXrldgxbDzYjRU4FF17ST5PU9uAO1lIwiUjXlciNKU10983eyjBYz23mK8TWT2Adk1AJHkVdlz5wzMVCL3/yLMOs6FmDDXNSn/isHZ+YACDwLIGfYwoWZdxPeq07iDCH x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 1dae30ee-74ed-4704-f91f-08d5669ea14b x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(48565401081)(5600026)(4604075)(3008032)(2017052603307)(7193020);SRVR:MW2PR2101MB1115; x-ms-traffictypediagnostic: MW2PR2101MB1115: authentication-results: spf=none (sender IP is ) smtp.mailfrom=Alexander.Levin@microsoft.com; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(89211679590171)(42068640409301)(104084551191319); x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(61425038)(6040501)(2401047)(5005006)(8121501046)(93006095)(93001095)(3002001)(10201501046)(3231101)(944501161)(6055026)(61426038)(61427038)(6041288)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123564045)(20161123562045)(6072148)(201708071742011);SRVR:MW2PR2101MB1115;BCL:0;PCL:0;RULEID:;SRVR:MW2PR2101MB1115; x-forefront-prvs: 05669A7924 x-forefront-antispam-report: SFV:NSPM;SFS:(10019020)(376002)(346002)(39860400002)(396003)(366004)(39380400002)(199004)(189003)(3280700002)(2906002)(4326008)(6486002)(6512007)(102836004)(53936002)(97736004)(1076002)(3660700001)(105586002)(6306002)(3846002)(54906003)(110136005)(186003)(66066001)(25786009)(26005)(305945005)(6116002)(99286004)(107886003)(6436002)(81156014)(5250100002)(81166006)(8676002)(22452003)(86362001)(2950100002)(36756003)(316002)(478600001)(106356001)(8936002)(2501003)(5660300001)(7736002)(6666003)(72206003)(10090500001)(68736007)(10290500003)(86612001)(2900100001)(14454004)(966005)(76176011)(6506007)(22906009)(217873001);DIR:OUT;SFP:1102;SCL:1;SRVR:MW2PR2101MB1115;H:MW2PR2101MB1034.namprd21.prod.outlook.com;FPR:;SPF:None;PTR:InfoNoRecords;A:1;MX:1;LANG:en; x-microsoft-antispam-message-info: 5yHIED2Q+kyfRw/Kq63rDHo+faU1STVCysxdDdUGZBmbgguZEw/qN3UP5M8O9xU3GqpyuLZftAA8zmFokG131A== spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: microsoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1dae30ee-74ed-4704-f91f-08d5669ea14b X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Jan 2018 22:28:27.0123 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47 X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW2PR2101MB1115 Sender: stable-owner@vger.kernel.org X-Mailing-List: stable@vger.kernel.org X-getmail-retrieved-from-mailbox: INBOX X-Mailing-List: linux-kernel@vger.kernel.org List-ID: From: Satheesh Rajendran [ Upstream commit 321a7c35c90cc834851ceda18a8ee18f1d032b92 ] Certain systems are designed to have sparse/discontiguous nodes. On such systems, 'perf bench numa' hangs, shows wrong number of nodes and shows values for non-existent nodes. Handle this by only taking nodes that are exposed by kernel to userspace. Signed-off-by: Satheesh Rajendran Reviewed-by: Srikar Dronamraju Acked-by: Naveen N. Rao Link: http://lkml.kernel.org/r/1edbcd353c009e109e93d78f2f46381930c340fe.151= 1368645.git.sathnaga@linux.vnet.ibm.com Signed-off-by: Balamuruhan S Signed-off-by: Arnaldo Carvalho de Melo Signed-off-by: Sasha Levin --- tools/perf/bench/numa.c | 56 ++++++++++++++++++++++++++++++++++++++++++++-= ---- 1 file changed, 51 insertions(+), 5 deletions(-) diff --git a/tools/perf/bench/numa.c b/tools/perf/bench/numa.c index b4eb5b679081..73d192f57dc3 100644 --- a/tools/perf/bench/numa.c +++ b/tools/perf/bench/numa.c @@ -208,6 +208,47 @@ static const char * const numa_usage[] =3D { NULL }; =20 +/* + * To get number of numa nodes present. + */ +static int nr_numa_nodes(void) +{ + int i, nr_nodes =3D 0; + + for (i =3D 0; i < g->p.nr_nodes; i++) { + if (numa_bitmask_isbitset(numa_nodes_ptr, i)) + nr_nodes++; + } + + return nr_nodes; +} + +/* + * To check if given numa node is present. + */ +static int is_node_present(int node) +{ + return numa_bitmask_isbitset(numa_nodes_ptr, node); +} + +/* + * To check given numa node has cpus. + */ +static bool node_has_cpus(int node) +{ + struct bitmask *cpu =3D numa_allocate_cpumask(); + unsigned int i; + + if (cpu && !numa_node_to_cpus(node, cpu)) { + for (i =3D 0; i < cpu->size; i++) { + if (numa_bitmask_isbitset(cpu, i)) + return true; + } + } + + return false; /* lets fall back to nocpus safely */ +} + static cpu_set_t bind_to_cpu(int target_cpu) { cpu_set_t orig_mask, mask; @@ -236,12 +277,12 @@ static cpu_set_t bind_to_cpu(int target_cpu) =20 static cpu_set_t bind_to_node(int target_node) { - int cpus_per_node =3D g->p.nr_cpus/g->p.nr_nodes; + int cpus_per_node =3D g->p.nr_cpus / nr_numa_nodes(); cpu_set_t orig_mask, mask; int cpu; int ret; =20 - BUG_ON(cpus_per_node*g->p.nr_nodes !=3D g->p.nr_cpus); + BUG_ON(cpus_per_node * nr_numa_nodes() !=3D g->p.nr_cpus); BUG_ON(!cpus_per_node); =20 ret =3D sched_getaffinity(0, sizeof(orig_mask), &orig_mask); @@ -641,7 +682,7 @@ static int parse_setup_node_list(void) int i; =20 for (i =3D 0; i < mul; i++) { - if (t >=3D g->p.nr_tasks) { + if (t >=3D g->p.nr_tasks || !node_has_cpus(bind_node)) { printf("\n# NOTE: ignoring bind NODEs starting at NODE#%d\n", bind_no= de); goto out; } @@ -956,6 +997,8 @@ static void calc_convergence(double runtime_ns_max, dou= ble *convergence) sum =3D 0; =20 for (node =3D 0; node < g->p.nr_nodes; node++) { + if (!is_node_present(node)) + continue; nr =3D nodes[node]; nr_min =3D min(nr, nr_min); nr_max =3D max(nr, nr_max); @@ -976,8 +1019,11 @@ static void calc_convergence(double runtime_ns_max, d= ouble *convergence) process_groups =3D 0; =20 for (node =3D 0; node < g->p.nr_nodes; node++) { - int processes =3D count_node_processes(node); + int processes; =20 + if (!is_node_present(node)) + continue; + processes =3D count_node_processes(node); nr =3D nodes[node]; tprintf(" %2d/%-2d", nr, processes); =20 @@ -1283,7 +1329,7 @@ static void print_summary(void) =20 printf("\n ###\n"); printf(" # %d %s will execute (on %d nodes, %d CPUs):\n", - g->p.nr_tasks, g->p.nr_tasks =3D=3D 1 ? "task" : "tasks", g->p.nr_nodes,= g->p.nr_cpus); + g->p.nr_tasks, g->p.nr_tasks =3D=3D 1 ? "task" : "tasks", nr_numa_nodes(= ), g->p.nr_cpus); printf(" # %5dx %5ldMB global shared mem operations\n", g->p.nr_loops, g->p.bytes_global/1024/1024); printf(" # %5dx %5ldMB process shared mem operations\n", --=20 2.11.0