From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id E7098C433EF for ; Mon, 30 May 2022 11:41:04 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S235614AbiE3LlD (ORCPT ); Mon, 30 May 2022 07:41:03 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:41748 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S235605AbiE3LlC (ORCPT ); Mon, 30 May 2022 07:41:02 -0400 Received: from mail-pg1-x535.google.com (mail-pg1-x535.google.com [IPv6:2607:f8b0:4864:20::535]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4ECB0813C9 for ; Mon, 30 May 2022 04:41:00 -0700 (PDT) Received: by mail-pg1-x535.google.com with SMTP id e66so9923971pgc.8 for ; Mon, 30 May 2022 04:41:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=xsaAxqFl4zGSeLovFTKDrnMk7tw175f/FTFh5rXVk2U=; b=bg7eCRengvOoWK5cVv33+mjM/3YbPDgRQdp6xJnUZ8eJaFOLMoBnMzNJTUCiKulyi5 c/PY/eaqHOSoVQuQF2rzbB5nZ5hF1DT8j3CY5B5iqEwFT4ZOriaEnRD8Y8I5YIA9eIxs caNH5c/62iU7ahM6/ne6ipd8g9Xl3hAZyAYVCFeScX16SESfSeSsavTMfFKRi2zna5lW NpV8gxuVUbsVPC0urWtI5QGUEtaAI+Rz+nradOZFsPve7BZH4ObOSmL9AqeqUVbituwt a02RTTIZWl0hGI+gKSHBOUeFJ/fIZA/RoROzc5GbWcxWkwKTM9Tl85kNqBEABgEH+Ze9 xCag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=xsaAxqFl4zGSeLovFTKDrnMk7tw175f/FTFh5rXVk2U=; b=7iO8qfbiAdjCzVHW6UUynO9A2dY1onZXHtZqFOpptty5V4U0GJGDeMa6UW4sn2Yyzl BuR9UoHyaIJu7WI4ytkJeKqmRvI2TDbZmjhS1EBWV3D0UmQSjux0SCsYN6M1osaqC2sK kZYwcjWZS3FvMEWFHMFfRvjVgkDSbmUtWSgx2QAsSUcQ0atqYHeS1b9tEUTqK05hgIHV 7JRdjEaZVaM6QgA69hujBw1JnACy1li0L/i3+obSAlinD1RklqRp6E6tBj8/PwFmpr0J A3mZceaq3WBdhLiI4uDcwn+KS5Nty21boZ6r7ugQHuIj+tvXGVzKgVfHX+VvdISiiObp 2hBA== X-Gm-Message-State: AOAM531LIg5TvI7mBUjrys1cBV3nICKu4dAcyIbv9XOdVwuEHJx82fZK 17nJT1ea64186XPKSnEW4lYL9Q== X-Google-Smtp-Source: ABdhPJzVhp1HabhW8c/glhoMTIQOeghcrv84GVI2L6XN5oqLxMkBfO2Lu8D43n+dBw9RxgvVnTT6Rg== X-Received: by 2002:a65:6852:0:b0:3fa:9371:9de with SMTP id q18-20020a656852000000b003fa937109demr28987190pgt.413.1653910859683; Mon, 30 May 2022 04:40:59 -0700 (PDT) Received: from leo-build-box.lan (n058152077182.netvigator.com. [58.152.77.182]) by smtp.gmail.com with ESMTPSA id c7-20020a170902724700b00161a9df4de8sm8846194pll.145.2022.05.30.04.40.55 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 30 May 2022 04:40:59 -0700 (PDT) From: Leo Yan To: Arnaldo Carvalho de Melo , Peter Zijlstra , Ingo Molnar , Mark Rutland , Alexander Shishkin , Jiri Olsa , Namhyung Kim , Alyssa Ross , Ian Rogers , Like Xu , Kajol Jain , Li Huafei , Joe Mario , Adam Li , German Gomez , James Clark , Ali Saidi , linux-perf-users@vger.kernel.org, linux-kernel@vger.kernel.org Cc: Leo Yan Subject: [PATCH v4 00/12] perf c2c: Support display for Arm64 Date: Mon, 30 May 2022 19:40:24 +0800 Message-Id: <20220530114036.3225544-1-leo.yan@linaro.org> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Precedence: bulk List-ID: X-Mailing-List: linux-perf-users@vger.kernel.org Arm64 Neoverse CPUs supports data source in Arm SPE trace, this allows us to detect cache line contention and transfers. This patch set is based on Ali Said's patch set v9 "perf: arm-spe: Decode SPE source and use for perf c2c" [1] and Ali's patch set doesn't need any change in this new round. To clearly show peer loads and express the local peer loads and remote peer lodes, this patch introduces three new metrics 'lcl_peer', 'rmt_peer' and 'tot_peer'. The display 'peer' mode uses metric 'tot_peer' for sorting cache lines. Patches 01-05 adds statistics for memory samples, and add dimensions for peer metrics. Patches 06-09 are for refactoring, it refines the code with more general naming so this can allow us to easier to extend display modes but not strictly bound to HITM tags. Patches 10-11 are to extend display 'peer' mode, and also changes to use 'peer' mode as default mode for Arm64 arches. Patch 12 updates document to describe the new dimensions for peer metrics. This patch set has been verified for both x86 and Arm64 memory samples. Known issues: Joe reminded there have an issue in patch set v3 that the cache line metric shows 'N/A' for node, this is because Arm SPE trace data doesn't contain physical address and leads to perf c2c tool fails to find matched node range if physical address is zero. This issue is addressed in a separte patch [2]. Since I am still using the old perf data file (I have no Neoverse platforms), the output result still shows the Node field is 'N/A'. Another thing is we need to enhance data source setting for old Arm platforms. As discussed, German would follow up this task later. The latest patch set has been uploaded on the git server [3]. The display result with x86 memory samples: ================================================= Shared Data Cache Line Table ================================================= # # ----------- Cacheline ---------- Tot ------- Load Hitm ------- Total Total Total --------- Stores -------- ----- Core Load Hit ----- - LLC Load Hit -- - RMT Load Hit -- --- Load Dram ---- # Index Address Node PA cnt Hitm Total LclHitm RmtHitm records Loads Stores L1Hit L1Miss N/A FB L1 L2 LclHit LclHitm RmtHit RmtHitm Lcl Rmt # ..... .................. .... ...... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ........ ....... ........ ....... ........ ........ # 0 0x55c8971f0080 0 1967 66.14% 252 252 0 6044 3550 2494 2024 470 0 528 2672 78 20 252 0 0 0 0 1 0x55c8971f00c0 0 1 33.86% 129 129 0 914 914 0 0 0 0 272 374 52 87 129 0 0 0 0 ================================================= Shared Cache Line Distribution Pareto ================================================= # # ----- HITM ----- ------- Store Refs ------ --------- Data address --------- ---------- cycles ---------- Total cpu Shared # Num RmtHitm LclHitm L1 Hit L1 Miss N/A Offset Node PA cnt Code address rmt hitm lcl hitm load records cnt Symbol Object Source:Line Node # ..... ....... ....... ....... ....... ....... .................. .... ...... .................. ........ ........ ........ ....... ........ ...................... ................. ....................... .... # ---------------------------------------------------------------------- 0 0 252 2024 470 0 0x55c8971f0080 ---------------------------------------------------------------------- 0.00% 12.30% 0.00% 0.00% 0.00% 0x0 0 1 0x55c8971ed3e9 0 1313 863 1222 3 [.] 0x00000000000013e9 false_sharing.exe false_sharing.exe[13e9] 0 0.00% 0.79% 90.51% 0.00% 0.00% 0x0 0 1 0x55c8971ed3e2 0 1800 878 3029 3 [.] 0x00000000000013e2 false_sharing.exe false_sharing.exe[13e2] 0 0.00% 0.00% 9.49% 100.00% 0.00% 0x0 0 1 0x55c8971ed3f4 0 0 0 662 3 [.] 0x00000000000013f4 false_sharing.exe false_sharing.exe[13f4] 0 0.00% 86.90% 0.00% 0.00% 0.00% 0x20 0 1 0x55c8971ed447 0 141 103 1131 2 [.] 0x0000000000001447 false_sharing.exe false_sharing.exe[1447] 0 ---------------------------------------------------------------------- 1 0 129 0 0 0 0x55c8971f00c0 ---------------------------------------------------------------------- 0.00% 100.00% 0.00% 0.00% 0.00% 0x20 0 1 0x55c8971ed455 0 88 94 914 2 [.] 0x0000000000001455 false_sharing.exe false_sharing.exe[1455] 0 The display result with Arm SPE: ================================================= Shared Data Cache Line Table ================================================= # # ----------- Cacheline ---------- Peer ------- Load Peer ------- Total Total Total --------- Stores -------- ----- Core Load Hit ----- - LLC Load Hit -- - RMT Load Hit -- --- Load Dram ---- # Index Address Node PA cnt Snoop Total Local Remote records Loads Stores L1Hit L1Miss N/A FB L1 L2 LclHit LclHitm RmtHit RmtHitm Lcl Rmt # ..... .................. .... ...... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ....... ........ ....... ........ ....... ........ ........ # 0 0xaaaac17d6000 N/A 0 100.00% 99 99 0 18851 18851 0 0 0 0 0 18752 0 99 0 0 0 0 0 ================================================= Shared Cache Line Distribution Pareto ================================================= # # -- Peer Snoop -- ------- Store Refs ------ --------- Data address --------- ---------- cycles ---------- Total cpu Shared # Num Rmt Lcl L1 Hit L1 Miss N/A Offset Node PA cnt Code address rmt peer lcl peer load records cnt Symbol Object Source:Line Node{cpus %peers %stores} # ..... ....... ....... ....... ....... ....... .................. .... ...... .................. ........ ........ ........ ....... ........ ...................... ................ ............... .... # ---------------------------------------------------------------------- 0 0 99 0 0 0 0xaaaac17d6000 ---------------------------------------------------------------------- 0.00% 6.06% 0.00% 0.00% 0.00% 0x20 N/A 0 0xaaaac17c25ac 0 375 43 18469 2 [.] 0x00000000000025ac memstress memstress[25ac] 0{ 2 100.0% n/a} 0.00% 93.94% 0.00% 0.00% 0.00% 0x29 N/A 0 0xaaaac17c3e88 0 180 173 135 2 [.] 0x0000000000003e88 memstress memstress[3e88] 0{ 2 100.0% n/a} Changes from v3: * Changed to display remote and local peer accesses (Joe); * Fixed the usage info for display types (Joe); * Do not display HITM dimensions when use 'peer' display, and HITM display doesn't show any 'peer' dimensions (James); * Split to smaller patches for adding dimensions of peer operations; * Updated documentation to reflect the latest GUI and stdio. Changes from v2: * Updated patch 04 to account metrics for both cache level and ld_peer for PEER flag; * Updated document for metric 'rmt_hit' which is accounted for all remote accesses (include remote DRAM and any upward caches). Changes from v1: * Updated patches 01, 02 and 03 to support 'N/A' metrics for store operations, so can align with the patch set [1] for store samples. [1] https://lore.kernel.org/lkml/20220517020326.18580-1-alisaidi@amazon.com/ [2] https://lore.kernel.org/lkml/20220530083645.253432-1-leo.yan@linaro.org/ [3] https://git.linaro.org/people/leo.yan/linux-spe.git/ branch: perf_c2c_arm_spe_peer_v4 Leo Yan (12): perf mem: Add statistics for peer snooping perf c2c: Output statistics for peer snooping perf c2c: Add dimensions for peer load operations perf c2c: Add dimensions of peer metrics for cache line view perf c2c: Add mean dimensions for peer operations perf c2c: Use explicit names for display macros perf c2c: Rename dimension from 'percent_hitm' to 'percent_costly_snoop' perf c2c: Refactor node header perf c2c: Refactor display string perf c2c: Sort on peer snooping for load operations perf c2c: Use 'peer' as default display for Arm64 perf c2c: Update documentation for new display option 'peer' tools/perf/Documentation/perf-c2c.txt | 30 +- tools/perf/builtin-c2c.c | 454 ++++++++++++++++++++------ tools/perf/util/mem-events.c | 28 +- tools/perf/util/mem-events.h | 3 + 4 files changed, 403 insertions(+), 112 deletions(-) -- 2.25.1