From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id E23ACC5AC7C for ; Fri, 7 Aug 2026 10:55:22 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:Content-Transfer-Encoding: MIME-Version:Message-ID:Date:Subject:Cc:To:From:Reply-To:Content-Type: Content-ID:Content-Description:Resent-Date:Resent-From:Resent-Sender: Resent-To:Resent-Cc:Resent-Message-ID:In-Reply-To:References:List-Owner; bh=8q9ULwdkDG8kHy0Moqf7BNCLWQcy+jQO/aL/rKEA8ck=; b=CibK9409gMN1jmfVUJwgXxBDKW UvO3t66oJPfdJix3zDN6fJQ3HG+NtdcPWBDtt5bxbSODs4NhOxxk9J4GTuCJfZxm0B8Ph86tARdjZ ahRb8OO4vG6jYuZb9xBi9V1QEqmiGqtts+vfXSZLoJId5iLAi74tRM6IrdPZPRpgY/1PlR7SDCxNa tteZv0qoOfRG2VUmpulmwL8Ohpng6Cf0++I1AiVCLEDFsEbIsD4EAh65P8FN40QUE2Ry7jc3zjVSS n/GtFS+nKXexdgWT5UXe2TVZ6gOXO4DFvl1MTwL6W2GrN9u5Hw+IpBKOFTR4oUV+BDBtSvGlcy+my XE4Aadcg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1wsIEK-00000007lCy-13g6; Fri, 07 Aug 2026 10:55:12 +0000 Received: from foss.arm.com ([217.140.110.172]) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1wsIEG-00000007lBj-1qho for linux-arm-kernel@lists.infradead.org; Fri, 07 Aug 2026 10:55:10 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 39E3D1A9A; Fri, 7 Aug 2026 03:55:01 -0700 (PDT) Received: from e142021.fritz.box (usa-sjc-mx-foss1.foss.arm.com [172.31.20.19]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 919843F9A2; Fri, 7 Aug 2026 03:55:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1786100105; bh=nzDEIT0IHsDQYduY3F1VMVOlzPwwS9lmWton6lQS11s=; h=From:To:Cc:Subject:Date:From; b=cbFS4Tp92l/3uEkgZBPZe15E1sNZsZdeD3RWnQctYLk2BEh+z97600XCbaZx/VvV1 9v9Yc5HhpCMX+/vrV85gnvQp75y9704xS2vOFeKMeTxnLxha8mb8vjQBfArcGTYccA Sfp5xbBKbwlJCs9Nu726CdHjZ+eB3JkIM/rdhToE= From: Andre Przywara To: Lorenzo Pieralisi , Hanjun Guo , Sudeep Holla , Catalin Marinas , Will Deacon , "Rafael J . Wysocki" , Len Brown , James Morse , Ben Horgan , Reinette Chatre , Fenghua Yu Cc: Jonathan Cameron , Srivathsa L Rao , Ganapatrao Kulkarni , Trilok Soni , Srinivas Ramana , Niyas Sait , Lee Trager , Ritwick Sharma , Gavin Shan , linux-acpi@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org Subject: [PATCH v9 00/12] arm_mpam: Add MPAM-Fb firmware support Date: Fri, 7 Aug 2026 12:54:39 +0200 Message-ID: <20260807105451.3728284-1-andre.przywara@arm.com> X-Mailer: git-send-email 2.43.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.9.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260807_035508_615884_60F0E013 X-CRM114-Status: GOOD ( 33.02 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Hi, v9 of the MPAM-Fb code, for firmware based MSC accesses, fixes some bugs and is addressing some of Sashiko's comments. Mostly to not leave known bugs out in the open, I suspect to continue properly after -rc1. The IRQ handling has been revamped (again), but this time hopefully for good, as I tested error IRQ injection, in various combinations of edge triggered, level triggered, shared and exclusive interrupts, across multiple MPAM-Fb and MMIO accessed MSCs, including sabotaging the line deactivation on the device (emulation) side, to test the irqchip side disabling. v8 failed some tests, but v9 passes now. This lead to a new patch adding error propagation to functions dealing with the interrupt configuration. Find the changelog below. Based on v7.2-rc1. ======================= The Arm MPAM specification defines Memory System Components (MSCs), which are devices that are programmed through an MMIO register frame. In some occasions this turned out to be too limiting: the MSC might be located behind a separate bus system (for instance inside an on-board controller), it might be mapped secure-only, or in a different processor socket without direct MMIO mapping. Also the MMIO access might be too slow or it would need to be filtered or otherwise access controlled. Finally there might be bugs in the MSC integration, which require a mediating firmware to be accessible. To accommodate all those different use cases, the MPAM-Fb specification [1] describes an alternative way to access MSCs. Accesses to an MSC would be wrapped in a message and communicated to the system using a shared-memory/mailbox system mostly mimicking the Arm SCMI spec. For ACPI systems, this would be abstracted through an ACPI PCC channel, which provides the shared-memory region and the mailbox trigger. We can lean on existing ACPI parsing code to register with these two subsystems, but cannot rely on the existing SCMI code in the kernel. This means we somewhat need to open code a very simplified SCMI handler, which just provides enough functionality for the very basic subset of SCMI that the MPAM-Fb spec requires. The first eight patches rework all MSC access wrappers to propagate error information. Pure MMIO based MSC accesses would never fail, but the MPAM-Fb access can go wrong in multiple ways. The patches have been split up purely for reviewing reasons, if the number is a problem, we could as well squash them. Please note that until the very last patch of this series any MSC accesses would always only return 0, it's only the final enablement of MPAM-Fb that could possibly introduce errors. Hence all former patches can add error handling gradually, those code paths wouldn't be triggered before patch 12/12. Patch 9/12 solves a nasty problem: At the moment we protect stateful MSC register accesses (mon_sel) through a spinlock. Unfortunately the mailbox subsystem and the slow nature of the communication through this channel forbid MPAM-Fb access in atomic context. So this patch keeps using a spinlock for MMIO based accesses, but reverts to a mutex otherwise. We just deny taking the lock for MPAM-Fb in atomic context, ideally we wouldn't need that (no need to IPI another core when the MSC access does not need to be local to one particular core), or we simply deny that part of the functionality (access through perf). Patch 10/12 adds the code to redirect MSC accesses through the PCC shmem/mailbox system. Patch 11/12 reworks the error interrupt handler to use a threaded IRQ for MPAM-Fb, to be able to do MPAM-Fb MSC accesses inside (which might sleep). The final patch 12/12 then adds the code to detect and store the PCC channel information from the ACPI tables, and eventually enables MPAM-Fb accesses. This would enable systems where some MSCs are not accessible via MMIO to use those components anyway. Please have a look and test! Cheers, Andre [1] https://developer.arm.com/documentation/den0144/latest Changes in v9: - always create a threaded IRQ, but differ handling between PCC and MMIO - drop dev ptr setting for shared mailbox client (leave at NULL) - propagate errors from IRQ setup functions (incl. mpam_disable_msc_ecr) - improve MPAM-Fb error reporting (drop snprintf call) Changes in v8: - disable error IRQ on irqchip level when device side fails - use MSC dev pointer for dev_err() instead of mailbox one - smaller white space and formatting fixes - reorder MPAM-Fb definitions - rename error translation function to mpam_fb_to_linux_errno() - add review and test tags Changes in v7: - add tags - add new patch to propagate errors in mpam_reprogram_ris_partid() - prevent loop when mpam_diable() tries MSC accesses again - register MMIO error IRQ handler without IRQF_ONESHOT - re-use existing "err" variable instead of declaring "ret" - initialise mon_sel_lock later, to wait for interface decision - convert timeout units for nominal latency, between us and ms Changes in v6: - keep using hard IRQ handler for MMIO based accesses - move shmem buffer size and MPAM-Fb version check into mpam_fb.c - drop mutex guard in mpam_fb_send_request(), we use gotos anyway - factor out MPAM-Fb protocol error translation - add MPAM_FB_ERR_BUSY error code to translation - explicitly report also MPAM-Fb protocol error number when disabling MPAM - remove unneeded MPAM-Fb details from mpam_internal.h - drop leftover mpam_fb_msc_id usage Changes in v5: - do not initialise _high variables early - fix whitespace issues - add Jonathan's Reviewed-by: tags - init only either the spinlock OR the mutex for the mon_sel_lock - drop warning about mapped_hwpage_sz for MPAM-Fb in mpam_msc_zero_mbwu_l() - change IRQ handler to threaded handler, to allow MPAM-Fb MSC accesses - disallow per-CPU IRQs (PPIs) for MPAM-Fb - trigger MPAM disabling on MPAM-Fb protocol errors - fix MPAM_PROTOCOL_VERSION_CMD name - use PCC driver defined symbol for PCC_CHAN_FLAGS_IRQ - add comment about usage of PCC's .signature field - check for illegal MPAM-Fb command before sending request - drop CPU accessibility check for MPAM-Fb based MSC accesses - move MPAM-Fb protocol message structs inside build functions - add comment about largest message size - drop extra msc->mpam_fb_msc_id, in favour using pdev->id - use already defined local dev variable instead of &pdev->dev - use FIELD_GET() macro for MPAM-Fb protocol check - drop devm_mutex_init() for pcc_chan_lock Changes in v4: - unify error check patterns - use scoped_guard(mutex) and ACQUIRE to simplify error handling - use struct kref for PCC channel refcount - drop unused mailbox rx_callback function - increase size of props[] array to hold new msc_id property - set mailbox TX timeout based on ACPI MPAM table field - use devm_mutex_init() to allow automatic cleanup - avoid overwriting error value for arm,not-ready-us property read - prune MPAM-Fb protocol token to fit into bitmask inside register - check return value for AIDR read - use two separate MPAM-Fb protocol payload structs - prune header list for mpam_fb.c - drop "nrdy handled as an error" change - fix message size field in MPAM-Fb protocol shmem area - drop message size return from MPAM-Fb message build functions - bring back IRQ flag in MPAM-Fb protocol header Changes in v3: - drop inner/outer mon_sel lock patch, replace with simpler version - harmonise code patterns in error propagation changes - drop mon_sel lock before erroring out in mpam_ris_hw_probe_csu_nrdy() - refactor mpam_msc_read_mbwu_l() to return an error - drop special NRDY handling in __ris_msmon_read() - add IRQ numbers in error interrupt handler to help pinpoint failure - refactor MPAM-Fb message generation to accommodate more than read/write - check MPAM-Fb protocol version at probe time - drop mpam_fb.h header, merge into mpam_internal.h - translate MPAM-Fb error code in Linux codes where needed - clear IRQ flag bit in MPAM-Fb protocol header - drop unneeded endianness conversions when crafting MPAM-Fb message - use C struct to model MPAM-Fb message payload Changes in v2: - add patches to add error propagation to MSC access wrappers - drop former patch 1/5 (not needed) - drop lock in mpam_reprogram_msc(), to avoid double lock - add support for multiple MSCs per PCC channel - adjust SCMI protocol code to use a PCC subtype 3 channel - let PCC code handle the PCC channel negotiation (due to subtype 3) - drop SCMI names in shmem offsets, and use existing PCC type 3 struct - adjust shmem field offsets to match MPAM-Fb spec, not pure SCMI - prevent MPAM-Fb calls inside atomic smp_call_function_any() payload - skip all MSC accesses inside the IRQ handler when using MPAM-Fb Andre Przywara (12): arm_mpam: let low level MSC accessors return an error arm_mpam: propagate MSC access errors for hw_probe functions arm_mpam: propagate MSC access errors for MBWU counters arm_mpam: propagate MSC access errors for msmon helpers arm_mpam: propagate MSC access errors for __ris_msmon_read() arm_mpam: propagate MSC access errors for state saving function arm_mpam: propagate MSC access errors for mpam_reprogram_ris_partid() arm_mpam: propagate MSC access errors for interrupt control arm_mpam: prepare mon_sel locking for MPAM-Fb arm_mpam: add MPAM-Fb MSC firmware access support arm_mpam: change MPAM-Fb error IRQ to use a threaded IRQ handler arm_mpam: detect and enable MPAM-Fb PCC support drivers/resctrl/Makefile | 2 +- drivers/resctrl/mpam_devices.c | 884 ++++++++++++++++++++++++-------- drivers/resctrl/mpam_fb.c | 252 +++++++++ drivers/resctrl/mpam_internal.h | 62 ++- include/linux/arm_mpam.h | 2 +- 5 files changed, 965 insertions(+), 237 deletions(-) create mode 100644 drivers/resctrl/mpam_fb.c base-commit: dc59e4fea9d83f03bad6bddf3fa2e52491777482 -- 2.43.0