From: Dave Jiang <dave.jiang@intel.com>
To: "Fabio M. De Francesco" <fabio.m.de.francesco@linux.intel.com>,
linux-cxl@vger.kernel.org
Cc: Davidlohr Bueso <dave@stgolabs.net>,
Jonathan Cameron <jonathan.cameron@huawei.com>,
Alison Schofield <alison.schofield@intel.com>,
Vishal Verma <vishal.l.verma@intel.com>,
Ira Weiny <ira.weiny@intel.com>,
Dan Williams <dan.j.williams@intel.com>,
Robert Richter <rrichter@amd.com>,
ming.li@zohomail.com, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 0/4 v4] cxl/core: Enable Region creation/attach on x86 with LMH
Date: Fri, 5 Sep 2025 17:03:50 -0700 [thread overview]
Message-ID: <d6a523ed-06f5-45f8-b62c-8d424c317a6c@intel.com> (raw)
In-Reply-To: <91f42134-851d-446b-8b60-f93c429cfc59@intel.com>
On 9/4/25 5:07 PM, Dave Jiang wrote:
>
>
> On 7/24/25 7:20 AM, Fabio M. De Francesco wrote:
>> The CXL Fixed Memory Window Structure (CFMWS) describes zero or more Host
>> Physical Address (HPA) windows that are associated with each CXL Host
>> Bridge. Each window represents a contiguous HPA that may be interleaved
>> with one or more targets (CXL v3.1 - 9.18.1.3).
>>
>> The Low Memory Hole (LMH) of x86 is a range of addresses of physical low
>> memory to which systems cannot send transactions. On those systems, BIOS
>> publishes CFMWS which communicate the active System Physical Address (SPA)
>> ranges that map to a subset of the Host Physical Address (HPA) ranges. The
>> SPA range trims out the hole, and capacity in the endpoint is lost with no
>> SPA to map to CXL HPA in that hole.
>>
>> In the early stages of CXL Regions construction and attach on platforms
>> with Low Memory Holes, the driver fails and returns an error because it
>> expects that the CXL Endpoint Decoder range is a subset of the Root
>> Decoder's (SPA >= HPA). On x86 with LMH's, it happens that SPA < HPA.
>>
>> Therefore, detect x86 Low Memory Holes, match CXL Root and Endpoint
>> Decoders or already made CXL Regions and Decoders to allow the
>> construction of new CXL Regions and the attachment of Endpoint Decoders,
>> even if SPA < HPA. If needed because of LMH's, adjust the Endpoint Decoder
>> range end to match Root Decoder's.
>>
>> - Patch 1/4 changes the calling conventions of three match_*_by_range()
>> helpers in preparation of 3/4.
>> - Patch 2/4 Introduces helpers to detect LMH's and also one to adjust
>> the HPA range end for CXL Regions construction.
>> - Patch 3/4 enables CXL Regions construction and Endpoint Decoders
>> attachment by matching Root Decoders or Regions with Endpoint
>> Decoders, adjusting Endpoint Decoders HPA range end, and relaxing
>> constraints while Endpoints decoders' attachment.
>> - Patch 4/4 simulates a LMH for the CXL tests on patched CXL driver.
>>
>> Many thanks to Alison, Dan, Dave and Ira for their help.
>>
>> Commenting on v1, Alison wrote a couple of observations on what users
>> will see. I suggest anyone interested to see how this series affect
>> users to take a look at her observations.[0] Thank you!
>>
>> Changes for v4:
>>
>> Re-base on top of
>> "cxl: Address translation support, part 1: Cleanups and refactoring";[1]
>> Drop no more necessary 2/4;
>> Drop collected tags because of major changes throughout the series.
>>
>> 1/3 - Adjust Endpoint Decoders dpa_res->end (Alison) [2]
>> 3/3 - Use weak/strong mechanism (Dan) [3]
>>
>> Changes for v3:
>>
>> Re-base the series on cxl/next.
>>
>> 1/4 - 2/4:
>> Constify local variables.
>> 3/4:
>> Call arch_match_region() from region_res_match_cxl_range().
>> 4/4:
>> arch_match_region() - Check that region end is under start + 4G;
>> arch_match_spa() - Check that SPA range start is cfmws_range_start.
>>
>> v3 - https://lore.kernel.org/linux-cxl/20250314113708.759808-1-fabio.m.de.francesco@linux.intel.com/
>> v2 - https://lore.kernel.org/linux-cxl/20250114203432.31861-1-fabio.m.de.francesco@linux.intel.com/
>> v1 - https://lore.kernel.org/all/20241122155226.2068287-1-fabio.m.de.francesco@linux.intel.com/
>>
>> [0] - https://lore.kernel.org/all/Z0Tzif55CcHuujJ-@aschofie-mobl2.lan/
>> [1] - https://lore.kernel.org/linux-cxl/20250509150700.2817697-1-rrichter@amd.com/
>> [2] - https://lore.kernel.org/linux-cxl/Z9tzZkn1rqd2Uk_6@aschofie-mobl2.lan/
>> [3] - https://lore.kernel.org/linux-cxl/67ee07cd4f8ec_1c2c6294d5@dwillia2-xfh.jf.intel.com.notmuch/
>>
>> Fabio M. De Francesco (4):
>> cxl/core: Change match_*_by_range() signatures
>> cxl/core: Add helpers to detect Low Memory Holes on x86
>> cxl/core: Enable Region creation on x86 with LMH
>> cxl/test: Simulate an x86 Low Memory Hole for tests
>>
>> drivers/cxl/Kconfig | 5 ++
>> drivers/cxl/core/Makefile | 1 +
>> drivers/cxl/core/platform.c | 86 +++++++++++++++++++
>> drivers/cxl/core/platform.h | 32 +++++++
>> drivers/cxl/core/region.c | 113 ++++++++++++++++--------
>> tools/testing/cxl/Kbuild | 2 +
>> tools/testing/cxl/mock_platform.c | 137 ++++++++++++++++++++++++++++++
>> tools/testing/cxl/test/cxl.c | 10 +++
>> tools/testing/cxl/test/mock.h | 1 +
>> 9 files changed, 352 insertions(+), 35 deletions(-)
>> create mode 100644 drivers/cxl/core/platform.c
>> create mode 100644 drivers/cxl/core/platform.h
>> create mode 100644 tools/testing/cxl/mock_platform.c
>>
>> base-commit: acc2913692413df9d1
>
> The series doesn't seem to apply to this base commit.
Please rebase v5 against v6.17-rc. Thanks!
>>
>
>
prev parent reply other threads:[~2025-09-06 0:03 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-07-24 14:20 [PATCH 0/4 v4] cxl/core: Enable Region creation/attach on x86 with LMH Fabio M. De Francesco
2025-07-24 14:20 ` [PATCH 1/4 v4] cxl/core: Change match_*_by_range() signatures Fabio M. De Francesco
2025-08-01 20:04 ` Cheatham, Benjamin
2025-08-13 12:27 ` Jonathan Cameron
2025-09-05 0:31 ` Dave Jiang
2025-07-24 14:20 ` [PATCH 2/4 v4] cxl/core: Add helpers to detect Low Memory Holes on x86 Fabio M. De Francesco
2025-08-01 20:04 ` Cheatham, Benjamin
2025-08-21 13:25 ` Fabio M. De Francesco
2025-09-18 14:23 ` Fabio M. De Francesco
2025-09-05 22:13 ` Dave Jiang
2025-07-24 14:20 ` [PATCH 3/4 v4] cxl/core: Enable Region creation on x86 with LMH Fabio M. De Francesco
2025-08-01 20:04 ` Cheatham, Benjamin
2025-08-21 15:15 ` Fabio M. De Francesco
2025-09-05 23:14 ` Dave Jiang
2025-07-24 14:20 ` [PATCH 4/4 v4] cxl/test: Simulate an x86 Low Memory Hole for tests Fabio M. De Francesco
2025-08-20 21:08 ` Alison Schofield
2025-09-08 18:26 ` Dave Jiang
2025-09-05 0:07 ` [PATCH 0/4 v4] cxl/core: Enable Region creation/attach on x86 with LMH Dave Jiang
2025-09-06 0:03 ` Dave Jiang [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=d6a523ed-06f5-45f8-b62c-8d424c317a6c@intel.com \
--to=dave.jiang@intel.com \
--cc=alison.schofield@intel.com \
--cc=dan.j.williams@intel.com \
--cc=dave@stgolabs.net \
--cc=fabio.m.de.francesco@linux.intel.com \
--cc=ira.weiny@intel.com \
--cc=jonathan.cameron@huawei.com \
--cc=linux-cxl@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=ming.li@zohomail.com \
--cc=rrichter@amd.com \
--cc=vishal.l.verma@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox