Re: [LSF/MM/BPF TOPIC] [RFC PATCH 0/4] mm/mempolicy: introduce socket-aware weighted interleave

Rakie Kim
2026-03-30T09:24:59Z

On Thu, 26 Mar 2026 21:54:30 -0400 Gregory Price <gourry@gourry.net> wrote:
> On Tue, Mar 24, 2026 at 02:35:45PM +0900, Rakie Kim wrote:
> > On Fri, 20 Mar 2026 16:56:05 +0000 Jonathan Cameron <jonathan.cameron@huawei.com> wrote:
> >
> > Init->Target | node0 | node1 | node2 | node3
> > node0 | 0x38B | 0x89F | 0x9C4 | 0x3AFC
> > node1 | 0x89F | 0x38B | 0x3AFC| 0x4268
> >
> > I used the identical type of DRAM and CXL memory for both sockets.
> > However, looking at the table, the local CXL access latency from
> > node0->node2 (0x9C4) and node1->node3 (0x4268) shows a massive,
> > unjustified difference. This asymmetry proves that the table is
> > currently unreliable.
> >
>
> Can you dump your CDAT for each device so you can at least check whether
> the device reports the same latency?
>
> Would at least tell the interested parties whether this is firmware or
> BIOS issue.
>
> sudo cat /sys/bus/cxl/devices/endpointN/CDAT | python3 cdat_dump.py
>
> ~Gregory
>
< --snip-- >

Hello Gregory,

Thank you for providing the python script. It was incredibly helpful.
I ran it across all the CDAT files found in my sysfs.

For context, my system currently has 16 CXL endpoints attached
(from `endpoint9` to `endpoint24`):
/sys/devices/platform/ACPI0017:00/root0/port.../endpoint.../CDAT

As Dave Jiang recently pointed out in this thread, the Intel BIOS
team confirmed that the HMAT values actually represent "end-to-end"
latency. By comparing these CDAT dump results (which show the
device-level latency) with the HMAT numbers, we should have a much
clearer picture of whether the massive asymmetry originates from the
device firmware itself or from the BIOS calculations.

I have attached the extracted CDAT dump results for the devices below.

Thanks again for your help in isolating this issue!

Rakie Kim

=== CDAT from endpoint16 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint20 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint18 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint17 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint14 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint10 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint23 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint22 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint15 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint11 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint12 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint19 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint13 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint9 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint21 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1

=== CDAT from endpoint24 ===
CDAT Header:
Length: 208 bytes
Revision: 1
Checksum: 0xc3 (OK)
Sequence: 0

[0] DSMAS (Device Scoped Memory Affinity Structure)
Offset: 16, Length: 24
DSMAD Handle: 0
Flags: 0x00 (None)
DPA Base: 0x0000000000000000
DPA Length: 0x0000002000000000 (128.00 GiB)

[1] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 40, Length: 24
Handle: 0
Flags: 0x00
Data Type: 0 (Access Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[2] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 64, Length: 24
Handle: 0
Flags: 0x00
Data Type: 1 (Read Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[3] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 88, Length: 24
Handle: 0
Flags: 0x00
Data Type: 2 (Write Latency)
Base Unit: 1000
Entry[0]: 110 -> 110.00 ns (110000 ps)

[4] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 112, Length: 24
Handle: 0
Flags: 0x00
Data Type: 3 (Access Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[5] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 136, Length: 24
Handle: 0
Flags: 0x00
Data Type: 4 (Read Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[6] DSLBIS (Device Scoped Latency and Bandwidth Information Structure)
Offset: 160, Length: 24
Handle: 0
Flags: 0x00
Data Type: 5 (Write Bandwidth)
Base Unit: 1000
Entry[0]: 45 -> 43.95 GB/s (45000 MB/s)

[7] DSEMTS (Device Scoped EFI Memory Type Structure)
Offset: 184, Length: 24
DSMAS Handle: 0
Memory Type: 0 (EfiConventionalMemory)
DPA Offset: 0x0000000000000000
Range Length: 0x0000002000000000 (128.00 GiB)

Summary: 8 entries
DSMAS (Device Scoped Memory Affinity Structure): 1
DSLBIS (Device Scoped Latency and Bandwidth Information Structure): 6
DSEMTS (Device Scoped EFI Memory Type Structure): 1