From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 74625C88E4A for ; Fri, 11 Sep 2026 11:32:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:Content-Transfer-Encoding: MIME-Version:Message-ID:Date:Subject:Cc:To:From:Reply-To:Content-Type: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References:List-Owner; bh=GdjioC2QgIQCjoxjQx+36rvfJ+m9li+uMHZqHLcDpZ4=; b=Z4ir8SlkitQEt3KxFl5lw8I89G ioPvfNrqw2KQ0MLPYdAWlRQ5vbz1lZejxwQ4HVFUVUqcrw73EN8cUiLtOhDEy3Dsf142bs8Riyjaq 6qumCs7tX6h7cQmzP7LgNti+Q89L9HJLdE664KtUREZL/uz7l7VfjOnoaIhmLJyzYGtc8iZksggnI 7Ad5v7Tx5pBZf3HLJIH70OfVpCLAS4XfCYkEbNgz9iX5vPmZhBcy0r/WQ1VQPXii32yuO4sq9KD3a M33GW27GicU4SnohTaPgNFle8PLH1XgwahvWgorCnKNjroldSSbnfCTisZOAEFrioJq4roBJ6POWv 0Ui8wmTQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1x4zR5-0000000GVEr-2dUS; Fri, 11 Sep 2026 11:28:51 +0000 Received: from foss.arm.com ([217.140.110.172]) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1x4zR2-0000000GVED-3vuL for linux-arm-kernel@lists.infradead.org; Fri, 11 Sep 2026 11:28:51 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id E0EDE16F2; Fri, 11 Sep 2026 04:28:42 -0700 (PDT) Received: from e142021.arm.com (unknown [10.57.6.75]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 918B33F59E; Fri, 11 Sep 2026 04:28:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1789126126; bh=Izwa20Ey+HsznaoR6Bo8Jp8ZYj96fAka076PFuib7lQ=; h=From:To:Cc:Subject:Date:From; b=KvhWGfXrHBOqfRALOHTG3VV95HNTwLmAZTx8ySd3TKYl9MCJF9u5SLdvV5WbGbc61 pAZdWKl7UxEyIMtbYRqwSskjCfOxjgUWr6gqfXd9s4h/dRRl53KoRwgrd8wFn2Vv49 zkzQ+3AV5hFTXJKDTvJWvhbUXqIR78hRZZdwfn7M= From: Andre Przywara To: Lorenzo Pieralisi , Hanjun Guo , Sudeep Holla , Catalin Marinas , Will Deacon , "Rafael J . Wysocki" , Len Brown , James Morse , Ben Horgan , Reinette Chatre , Fenghua Yu Cc: Jonathan Cameron , Srivathsa L Rao , Ganapatrao Kulkarni , Trilok Soni , Srinivas Ramana , Niyas Sait , Lee Trager , Ritwick Sharma , Gavin Shan , linux-acpi@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org Subject: [PATCH v10 00/14] arm_mpam: Add MPAM-Fb firmware support Date: Fri, 11 Sep 2026 13:28:21 +0200 Message-ID: <20260911112835.714162-1-andre.przywara@arm.com> X-Mailer: git-send-email 2.43.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.9.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260911_042849_058812_1B218BF5 X-CRM114-Status: GOOD ( 36.44 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Hi, as promised, this is an updated version of the MPAM-Fb code, for firmware based MSC accesses. There are not many changes, the most prominent one is preparation for an update to the "ACPI for MPAM" specification (Arm DEN0065 [2]), which adds an MPAM-Fb offset field, to allow private IDs per PCC channel, but still maintain globally unique MSC IDs. The spec is not public yet, but I added two small patches on top that would implement the change. Also the msc struct gains a field to hold that per-PCC value. This allows to support systems with more than one MPAM-Fb manager (read: PCC channel). Find the changelog below. Based on v7.3-rc1. ======================= The Arm MPAM specification defines Memory System Components (MSCs), which are devices that are programmed through an MMIO register frame. In some occasions this turned out to be too limiting: the MSC might be located behind a separate bus system (for instance inside an on-board controller), it might be mapped secure-only, or in a different processor socket without direct MMIO mapping. Also the MMIO access might be too slow or it would need to be filtered or otherwise access controlled. Finally there might be bugs in the MSC integration, which require a mediating firmware to be accessible. To accommodate all those different use cases, the MPAM-Fb specification [1] describes an alternative way to access MSCs. Accesses to an MSC would be wrapped in a message and communicated to the system using a shared-memory/mailbox system mostly mimicking the Arm SCMI spec. For ACPI systems, this would be abstracted through an ACPI PCC channel, which provides the shared-memory region and the mailbox trigger. We can lean on existing ACPI parsing code to register with these two subsystems, but cannot rely on the existing SCMI code in the kernel. This means we somewhat need to open code a very simplified SCMI handler, which just provides enough functionality for the very basic subset of SCMI that the MPAM-Fb spec requires. The first eight patches rework all MSC access wrappers to propagate error information. Pure MMIO based MSC accesses would never fail, but the MPAM-Fb access can go wrong in multiple ways. The patches have been split up purely for reviewing reasons, if the number is a problem, we could as well squash them. Please note that until the very last patch of this series any MSC accesses would always only return 0, it's only the final enablement of MPAM-Fb that could possibly introduce errors. Hence all former patches can add error handling gradually, those code paths wouldn't be triggered before patch 12/14. Patch 9/14 solves a nasty problem: At the moment we protect stateful MSC register accesses (mon_sel) through a spinlock. Unfortunately the mailbox subsystem and the slow nature of the communication through this channel forbid MPAM-Fb access in atomic context. So this patch keeps using a spinlock for MMIO based accesses, but reverts to a mutex otherwise. We just deny taking the lock for MPAM-Fb in atomic context, ideally we wouldn't need that (no need to IPI another core when the MSC access does not need to be local to one particular core), or we simply deny that part of the functionality (access through perf). Patch 10/14 adds the code to redirect MSC accesses through the PCC shmem/mailbox system. Patch 11/14 reworks the error interrupt handler to use a threaded IRQ for MPAM-Fb, to be able to do MPAM-Fb MSC accesses inside (which might sleep). Patch 12/14 then adds the code to detect and store the PCC channel information from the ACPI tables, and eventually enables MPAM-Fb accesses. The final two patches (marked as RFC) implement an "ACPI for MPAM" specification change, which introduces an MPAM-Fb Offset field, which holds the difference between the globally unique MSC IDs as stored in the "Identifier" field of the ACPI MSC node table, and the MSC ID to be used in the MPAM-Fb protocol. For a single MPAM-Fb manager/PCC channel, this is irrelevant, but multiple channels require that change. This whole series would enable systems where some MSCs are not accessible via MMIO to use those components anyway. Please have a look and test! Cheers, Andre [1] https://developer.arm.com/documentation/den0144/latest [2] https://support.arm.com/documentation/den0065/3-0/ Changes in v10: - rebase on v7.3-rc1 - add tags - (re-)introduce mpam_fb_msc_id field to allow per-PCC MSC IDs - add patch to introduce mpam_fb_offset ACPI MSC node field - add patch to adjust mpam_fb_msc_id if needed - add mon_sel_mutex comment - "select" missing KConfig symbols Changes in v9: - always create a threaded IRQ, but differ handling between PCC and MMIO - drop dev ptr setting for shared mailbox client (leave at NULL) - propagate errors from IRQ setup functions (incl. mpam_disable_msc_ecr) - improve MPAM-Fb error reporting (drop snprintf call) Changes in v8: - disable error IRQ on irqchip level when device side fails - use MSC dev pointer for dev_err() instead of mailbox one - smaller white space and formatting fixes - reorder MPAM-Fb definitions - rename error translation function to mpam_fb_to_linux_errno() - add review and test tags Changes in v7: - add tags - add new patch to propagate errors in mpam_reprogram_ris_partid() - prevent loop when mpam_diable() tries MSC accesses again - register MMIO error IRQ handler without IRQF_ONESHOT - re-use existing "err" variable instead of declaring "ret" - initialise mon_sel_lock later, to wait for interface decision - convert timeout units for nominal latency, between us and ms Changes in v6: - keep using hard IRQ handler for MMIO based accesses - move shmem buffer size and MPAM-Fb version check into mpam_fb.c - drop mutex guard in mpam_fb_send_request(), we use gotos anyway - factor out MPAM-Fb protocol error translation - add MPAM_FB_ERR_BUSY error code to translation - explicitly report also MPAM-Fb protocol error number when disabling MPAM - remove unneeded MPAM-Fb details from mpam_internal.h - drop leftover mpam_fb_msc_id usage Changes in v5: - do not initialise _high variables early - fix whitespace issues - add Jonathan's Reviewed-by: tags - init only either the spinlock OR the mutex for the mon_sel_lock - drop warning about mapped_hwpage_sz for MPAM-Fb in mpam_msc_zero_mbwu_l() - change IRQ handler to threaded handler, to allow MPAM-Fb MSC accesses - disallow per-CPU IRQs (PPIs) for MPAM-Fb - trigger MPAM disabling on MPAM-Fb protocol errors - fix MPAM_PROTOCOL_VERSION_CMD name - use PCC driver defined symbol for PCC_CHAN_FLAGS_IRQ - add comment about usage of PCC's .signature field - check for illegal MPAM-Fb command before sending request - drop CPU accessibility check for MPAM-Fb based MSC accesses - move MPAM-Fb protocol message structs inside build functions - add comment about largest message size - drop extra msc->mpam_fb_msc_id, in favour using pdev->id - use already defined local dev variable instead of &pdev->dev - use FIELD_GET() macro for MPAM-Fb protocol check - drop devm_mutex_init() for pcc_chan_lock Changes in v4: - unify error check patterns - use scoped_guard(mutex) and ACQUIRE to simplify error handling - use struct kref for PCC channel refcount - drop unused mailbox rx_callback function - increase size of props[] array to hold new msc_id property - set mailbox TX timeout based on ACPI MPAM table field - use devm_mutex_init() to allow automatic cleanup - avoid overwriting error value for arm,not-ready-us property read - prune MPAM-Fb protocol token to fit into bitmask inside register - check return value for AIDR read - use two separate MPAM-Fb protocol payload structs - prune header list for mpam_fb.c - drop "nrdy handled as an error" change - fix message size field in MPAM-Fb protocol shmem area - drop message size return from MPAM-Fb message build functions - bring back IRQ flag in MPAM-Fb protocol header Changes in v3: - drop inner/outer mon_sel lock patch, replace with simpler version - harmonise code patterns in error propagation changes - drop mon_sel lock before erroring out in mpam_ris_hw_probe_csu_nrdy() - refactor mpam_msc_read_mbwu_l() to return an error - drop special NRDY handling in __ris_msmon_read() - add IRQ numbers in error interrupt handler to help pinpoint failure - refactor MPAM-Fb message generation to accommodate more than read/write - check MPAM-Fb protocol version at probe time - drop mpam_fb.h header, merge into mpam_internal.h - translate MPAM-Fb error code in Linux codes where needed - clear IRQ flag bit in MPAM-Fb protocol header - drop unneeded endianness conversions when crafting MPAM-Fb message - use C struct to model MPAM-Fb message payload Changes in v2: - add patches to add error propagation to MSC access wrappers - drop former patch 1/5 (not needed) - drop lock in mpam_reprogram_msc(), to avoid double lock - add support for multiple MSCs per PCC channel - adjust SCMI protocol code to use a PCC subtype 3 channel - let PCC code handle the PCC channel negotiation (due to subtype 3) - drop SCMI names in shmem offsets, and use existing PCC type 3 struct - adjust shmem field offsets to match MPAM-Fb spec, not pure SCMI - prevent MPAM-Fb calls inside atomic smp_call_function_any() payload - skip all MSC accesses inside the IRQ handler when using MPAM-Fb Andre Przywara (14): arm_mpam: let low level MSC accessors return an error arm_mpam: propagate MSC access errors for hw_probe functions arm_mpam: propagate MSC access errors for MBWU counters arm_mpam: propagate MSC access errors for msmon helpers arm_mpam: propagate MSC access errors for __ris_msmon_read() arm_mpam: propagate MSC access errors for state saving function arm_mpam: propagate MSC access errors for mpam_reprogram_ris_partid() arm_mpam: propagate MSC access errors for interrupt control arm_mpam: prepare mon_sel locking for MPAM-Fb arm_mpam: add MPAM-Fb MSC firmware access support arm_mpam: change MPAM-Fb error IRQ to use a threaded IRQ handler arm_mpam: detect and enable MPAM-Fb PCC support ACPICA: actbl2.h: MPAM: adapt to MPAM ACPI v3.1 changes acpi: arm64: use MPAM-Fb offset field from ACPI table drivers/acpi/arm64/mpam.c | 5 +- drivers/resctrl/Kconfig | 2 + drivers/resctrl/Makefile | 2 +- drivers/resctrl/mpam_devices.c | 891 ++++++++++++++++++++++++-------- drivers/resctrl/mpam_fb.c | 252 +++++++++ drivers/resctrl/mpam_internal.h | 68 ++- include/acpi/actbl2.h | 2 +- include/linux/arm_mpam.h | 2 +- 8 files changed, 985 insertions(+), 239 deletions(-) create mode 100644 drivers/resctrl/mpam_fb.c base-commit: cee9395acd8043be0644b25c34bfa86623f2b935 -- 2.43.0