From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id C7261C00144 for ; Fri, 29 Jul 2022 07:44:04 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S234771AbiG2HoE (ORCPT ); Fri, 29 Jul 2022 03:44:04 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:53192 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S234545AbiG2HoD (ORCPT ); Fri, 29 Jul 2022 03:44:03 -0400 Received: from mail-pj1-x104a.google.com (mail-pj1-x104a.google.com [IPv6:2607:f8b0:4864:20::104a]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 19FA465809 for ; Fri, 29 Jul 2022 00:44:02 -0700 (PDT) Received: by mail-pj1-x104a.google.com with SMTP id r6-20020a17090a2e8600b001f0768a1af1so4024804pjd.8 for ; Fri, 29 Jul 2022 00:44:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=date:message-id:mime-version:subject:from:to:cc; bh=1Wg9cHm2UMgNHmJrbWYqWjDLkwNy+fZSAbVTsV+UQns=; b=imxY0j49nHkgRuVEtqcu1lSRSM5vwuyb3SjeUn8WrBKKWgIK3aBc/DJkUn0uVgqwOh Ej0opAKoYwLjSbESFDo0kegDOw4cDV0ByjwDcaEb6ChpE7xPt2dRxOjNZCN74daQ6OTF 8t37Vx+QadrW8tIzFFrrZG7lRomzlJ7cQsjdFeQmXPwnlSXdqoqJvbhVyX31Qa8Ybn4v V10uDxd0aNexsoDvQTOuXWxJ4ZGA2aQjrkkDzW+9zzNx6B3m4wqlza2fBJIMKZIGfXxq CPmT9NEsvcORRgNR4d0aIXB0JJN5C9i+yR1gseWIHqK6ALt4WvQy++imDh4cGjVOu6vQ QdUg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:message-id:mime-version:subject:from:to:cc; bh=1Wg9cHm2UMgNHmJrbWYqWjDLkwNy+fZSAbVTsV+UQns=; b=gGhwdn+5kCmhmwSdYvlCtI7Vyd7MEADiM8I9C6NN/dPlue4V43RC/eZGjXhCwE2ZZf y3e9AG44BmrqmKw9kqehcHiO1Oto+edTQvc/mL1KjiS4v1DMJ9qfwnYsnV/pWgKE8aaM /x4pDR7uJeTnoVkd7Oz8UZ72eXcDHbwij3d6+R8PcID0HjsMsigrRJ1Vh8dMsMBS3+XD +aw1VDz0e5LYOffzANKJJNuuMX885RVvjwyLAqcNy/kWQYBYxrLhYoSoFN4PLxvtNUMW hy0PFnSMRlNEowNBUVOJ+/MAZu2sKeuu/tbUnVvr59RrgWuTyr5XyF+OH0o7OUZtdMEt fJaQ== X-Gm-Message-State: AJIora+ijmfHt85yHE73FwuwGWOEmoKS+3oQbiOjeUvhchGPzQdcueKU VvSd8BICPom+2dszAffyb3RaCM35CHai X-Google-Smtp-Source: AGRyM1s5Kyemr2tcw/wnsGgnx2UTjqJzLMWlkCo84p8rnvtDM0dFBbz53/1DqEA7btgqXB4XxzCpKr2k1GtG X-Received: from irogers.svl.corp.google.com ([2620:15c:2d4:203:524b:47b4:2aeb:1b49]) (user=irogers job=sendgmr) by 2002:a05:6a00:1ac7:b0:52b:37ac:442c with SMTP id f7-20020a056a001ac700b0052b37ac442cmr2234362pfv.76.1659080641572; Fri, 29 Jul 2022 00:44:01 -0700 (PDT) Date: Fri, 29 Jul 2022 00:43:34 -0700 Message-Id: <20220729074351.138260-1-irogers@google.com> Mime-Version: 1.0 X-Mailer: git-send-email 2.37.1.455.g008518b4e5-goog Subject: [PATCH v3 00/17] Compress the pmu_event tables From: Ian Rogers To: John Garry , Will Deacon , James Clark , Mike Leach , Leo Yan , Peter Zijlstra , Ingo Molnar , Arnaldo Carvalho de Melo , Mark Rutland , Alexander Shishkin , Jiri Olsa , Namhyung Kim , Andi Kleen , Zhengjun Xing , Ravi Bangoria , Kan Liang , Adrian Hunter , linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-perf-users@vger.kernel.org Cc: Stephane Eranian , Ian Rogers Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-perf-users@vger.kernel.org jevents.py creates a number of large arrays from the json events. The arrays contain pointers to strings that need relocating. The relocations have file size, run time and memory costs. These changes refactor the pmu_events API so that the storage of the pmu_event struct isn't exposed. The format is then changed to an offset within a combined big string, with adjacent pmu_event struct variables being next to each other in the string separated by \0 - meaning only the first variable of the struct needs its offset recording. Some related fixes are contained with the patches. The architecture jevents.py creates tables for can now be set by the JEVENTS_ARCH make variable, with a new 'all' that generates the events and metrics for all architectures. An example of the improvement to the file size on x86 is: no jevents - the same 19,788,464bytes x86 jevents - ~16.7% file size saving 23,744,288bytes vs 28,502,632bytes all jevents - ~19.5% file size saving 24,469,056bytes vs 30,379,920bytes default build options plus NO_LIBBFD=1. I originally suggested fixing this problem in: https://lore.kernel.org/linux-perf-users/CAP-5=fVB8G4bdb9T=FncRTh9oBVKCS=+=eowAO+YSgAhab+Dtg@mail.gmail.com/ v3. Fix an ARM build issue with a missed weak symbol. Perform some pytype clean up. v2. Split the substring folding optimization to its own patch and comment tweaks as suggested by Namhyung Kim . Recompute the file size savings with the latest json events and metrics. Ian Rogers (17): perf jevents: Clean up pytype warnings perf jevents: Simplify generation of C-string perf jevents: Add JEVENTS_ARCH make option perf jevent: Add an 'all' architecture argument perf jevents: Remove the type/version variables perf jevents: Provide path to json file on error perf jevents: Sort json files entries perf pmu-events: Hide pmu_sys_event_tables perf pmu-events: Avoid passing pmu_events_map perf pmu-events: Hide pmu_events_map perf test: Use full metric resolution perf pmu-events: Move test events/metrics to json perf pmu-events: Don't assume pmu_event is an array perf pmu-events: Hide the pmu_events perf metrics: Copy entire pmu_event in find metric perf jevents: Compress the pmu_events_table perf jevents: Fold strings optimization tools/perf/arch/arm64/util/pmu.c | 4 +- tools/perf/pmu-events/Build | 6 +- .../arch/test/test_soc/cpu/metrics.json | 64 +++ tools/perf/pmu-events/empty-pmu-events.c | 204 +++++++- tools/perf/pmu-events/jevents.py | 495 ++++++++++++++---- tools/perf/pmu-events/pmu-events.h | 40 +- tools/perf/tests/expand-cgroup.c | 25 +- tools/perf/tests/parse-metric.c | 77 +-- tools/perf/tests/pmu-events.c | 466 +++++++---------- tools/perf/util/metricgroup.c | 275 ++++++---- tools/perf/util/metricgroup.h | 5 +- tools/perf/util/pmu.c | 139 ++--- tools/perf/util/pmu.h | 8 +- tools/perf/util/s390-sample-raw.c | 50 +- 14 files changed, 1140 insertions(+), 718 deletions(-) create mode 100644 tools/perf/pmu-events/arch/test/test_soc/cpu/metrics.json -- 2.37.1.455.g008518b4e5-goog