Linux Power Management development
 help / color / mirror / Atom feed
* Warning `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
@ 2025-01-27 12:41 Paul Menzel
  2025-01-27 15:43 ` Mario Limonciello
  0 siblings, 1 reply; 8+ messages in thread
From: Paul Menzel @ 2025-01-27 12:41 UTC (permalink / raw)
  To: Huang Rui, Gautham R. Shenoy, Mario Limonciello; +Cc: linux-pm

[-- Attachment #1: Type: text/plain, Size: 690 bytes --]

Dear Linux folks,


On a Dell PowerEdge R7625 with two 32x AMD EPYC 9174F Linux 6.12 logs

     $ dmesg | grep -e "DMI:" -e "Linux version" -e microcode
     [    0.000000] Linux version 6.12.11.mx64.479 
(root@lucy.molgen.mpg.de) (gcc (GCC) 12.3.0, GNU ld (GNU Binutils) 2.41) 
#1 SMP PREEMPT_DYNAMIC Fri Jan 24 13:30:47 CET 2025
     [    0.000000] DMI: Dell Inc. PowerEdge R7625/0M7YXP, BIOS 1.10.6 
12/06/2024
     [    0.000000] DMI: Memory slots populated: 4/24
     [    9.487804] amd_pstate: the _CPC object is not present in SBIOS 
or ACPI disabled
     [    9.733516] microcode: Current revision: 0x0a101148

ACPI is enabled. What can I do about the warning?


Kind regards,

Paul

[-- Attachment #2: 20250127--dell-poweredge-r7625--linux-6.12.11.txt --]
[-- Type: text/plain, Size: 104716 bytes --]

[    0.000000] Linux version 6.12.11.mx64.479 (root@lucy.molgen.mpg.de) (gcc (GCC) 12.3.0, GNU ld (GNU Binutils) 2.41) #1 SMP PREEMPT_DYNAMIC Fri Jan 24 13:30:47 CET 2025
[    0.000000] Command line: root=LABEL=root ro crashkernel=64G-:256M console=ttyS0,115200n8 console=tty0 init=/bin/systemd audit=0 random.trust_cpu=on systemd.unified_cgroup_hierarchy
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000100-0x000000000008efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000008f000-0x000000000008ffff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000000090000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000059cccfff] usable
[    0.000000] BIOS-e820: [mem 0x0000000059ccd000-0x0000000059ccffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000059cd0000-0x00000000677cefff] usable
[    0.000000] BIOS-e820: [mem 0x00000000677cf000-0x000000006dfcefff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006dfcf000-0x000000006edfefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000006edff000-0x000000006effefff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000006efff000-0x000000006effffff] usable
[    0.000000] BIOS-e820: [mem 0x000000006f000000-0x000000006fffffff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000070000000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000009c000000-0x000000009cffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000a9000000-0x00000000a9ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000b6000000-0x00000000b6ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000c3000000-0x00000000c3ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000d0000000-0x00000000d0ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000dd000000-0x00000000ddffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ea000000-0x00000000eaffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fd000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000207ebfffff] usable
[    0.000000] BIOS-e820: [mem 0x000000207ec00000-0x000000207fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000002080000000-0x000000407e8bffff] usable
[    0.000000] BIOS-e820: [mem 0x000000407e8c0000-0x000000407fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000010000000000-0x00000100201fffff] reserved
[    0.000000] BIOS-e820: [mem 0x000001dfa0000000-0x000001dfc01fffff] reserved
[    0.000000] BIOS-e820: [mem 0x000002bf40000000-0x000002bf601fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000039ee0000000-0x0000039f001fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000047e80000000-0x0000047ea01fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000055e20000000-0x0000055e401fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000063dc0000000-0x0000063de01fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000071d60000000-0x0000071d801fffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] APIC: Static calls initialized
[    0.000000] e820: update [mem 0x00100000-0x0010006f] usable ==> usable
[    0.000000] extended physical RAM map:
[    0.000000] reserve setup_data: [mem 0x0000000000000100-0x000000000008efff] usable
[    0.000000] reserve setup_data: [mem 0x000000000008f000-0x000000000008ffff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x0000000000090000-0x000000000009ffff] usable
[    0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000000010006f] usable
[    0.000000] reserve setup_data: [mem 0x0000000000100070-0x0000000059cccfff] usable
[    0.000000] reserve setup_data: [mem 0x0000000059ccd000-0x0000000059ccffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000059cd0000-0x00000000677cefff] usable
[    0.000000] reserve setup_data: [mem 0x00000000677cf000-0x000000006dfcefff] reserved
[    0.000000] reserve setup_data: [mem 0x000000006dfcf000-0x000000006edfefff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x000000006edff000-0x000000006effefff] ACPI data
[    0.000000] reserve setup_data: [mem 0x000000006efff000-0x000000006effffff] usable
[    0.000000] reserve setup_data: [mem 0x000000006f000000-0x000000006fffffff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x0000000070000000-0x000000008fffffff] reserved
[    0.000000] reserve setup_data: [mem 0x000000009c000000-0x000000009cffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000a9000000-0x00000000a9ffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000b6000000-0x00000000b6ffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000c3000000-0x00000000c3ffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000d0000000-0x00000000d0ffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000dd000000-0x00000000ddffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000ea000000-0x00000000eaffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fd000000-0x00000000ffffffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000207ebfffff] usable
[    0.000000] reserve setup_data: [mem 0x000000207ec00000-0x000000207fffffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000002080000000-0x000000407e8bffff] usable
[    0.000000] reserve setup_data: [mem 0x000000407e8c0000-0x000000407fffffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000010000000000-0x00000100201fffff] reserved
[    0.000000] reserve setup_data: [mem 0x000001dfa0000000-0x000001dfc01fffff] reserved
[    0.000000] reserve setup_data: [mem 0x000002bf40000000-0x000002bf601fffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000039ee0000000-0x0000039f001fffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000047e80000000-0x0000047ea01fffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000055e20000000-0x0000055e401fffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000063dc0000000-0x0000063de01fffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000071d60000000-0x0000071d801fffff] reserved
[    0.000000] efi: EFI v2.7 by Dell Inc.
[    0.000000] efi: ACPI=0x6effe000 ACPI 2.0=0x6effe014 TPMFinalLog=0x6ed95000 MEMATTR=0x62688020 SMBIOS=0x69794000 SMBIOS 3.0=0x69792000 
[    0.000000] efi: Remove mem01: MMIO range=[0x10000000000-0x100201fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x10000000000-0x100201fffff] reserved
[    0.000000] efi: Remove mem02: MMIO range=[0x9c000000-0x9cffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0x9c000000-0x9cffffff] reserved
[    0.000000] efi: Remove mem03: MMIO range=[0x2bf40000000-0x2bf601fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x2bf40000000-0x2bf601fffff] reserved
[    0.000000] efi: Remove mem04: MMIO range=[0xb6000000-0xb6ffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xb6000000-0xb6ffffff] reserved
[    0.000000] efi: Remove mem05: MMIO range=[0x47e80000000-0x47ea01fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x47e80000000-0x47ea01fffff] reserved
[    0.000000] efi: Remove mem07: MMIO range=[0xd0000000-0xd0ffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xd0000000-0xd0ffffff] reserved
[    0.000000] efi: Remove mem08: MMIO range=[0x63dc0000000-0x63de01fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x63dc0000000-0x63de01fffff] reserved
[    0.000000] efi: Remove mem10: MMIO range=[0xfd000000-0xffffffff] (48MB) from e820 map
[    0.000000] e820: remove [mem 0xfd000000-0xffffffff] reserved
[    0.000000] efi: Remove mem11: MMIO range=[0x80000000-0x8fffffff] (256MB) from e820 map
[    0.000000] e820: remove [mem 0x80000000-0x8fffffff] reserved
[    0.000000] efi: Remove mem12: MMIO range=[0x1dfa0000000-0x1dfc01fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x1dfa0000000-0x1dfc01fffff] reserved
[    0.000000] efi: Remove mem13: MMIO range=[0xa9000000-0xa9ffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xa9000000-0xa9ffffff] reserved
[    0.000000] efi: Remove mem14: MMIO range=[0x39ee0000000-0x39f001fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x39ee0000000-0x39f001fffff] reserved
[    0.000000] efi: Remove mem16: MMIO range=[0xc3000000-0xc3ffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xc3000000-0xc3ffffff] reserved
[    0.000000] efi: Remove mem17: MMIO range=[0x55e20000000-0x55e401fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x55e20000000-0x55e401fffff] reserved
[    0.000000] efi: Remove mem19: MMIO range=[0xdd000000-0xddffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xdd000000-0xddffffff] reserved
[    0.000000] efi: Remove mem20: MMIO range=[0x71d60000000-0x71d801fffff] (514MB) from e820 map
[    0.000000] e820: remove [mem 0x71d60000000-0x71d801fffff] reserved
[    0.000000] efi: Remove mem22: MMIO range=[0xea000000-0xeaffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xea000000-0xeaffffff] reserved
[    0.000000] SMBIOS 3.3.0 present.
[    0.000000] DMI: Dell Inc. PowerEdge R7625/0M7YXP, BIOS 1.10.6 12/06/2024
[    0.000000] DMI: Memory slots populated: 4/24
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 4099.937 MHz processor
[    0.000019] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000023] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000035] last_pfn = 0x407e8c0 max_arch_pfn = 0x10000000000
[    0.000044] MTRR map: 5 entries (2 fixed + 3 variable; max 19), built from 9 variable MTRRs
[    0.000047] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.001418] x2apic: enabled by BIOS, switching to x2apic ops
[    0.001426] last_pfn = 0x6f000 max_arch_pfn = 0x10000000000
[    0.009809] Using GB pages for direct mapping
[    0.010957] Secure boot could not be determined
[    0.010958] RAMDISK: [mem 0x407b1a8000-0x407bffffff]
[    0.010966] ACPI: Early table checksum verification disabled
[    0.010972] ACPI: RSDP 0x000000006EFFE014 000024 (v02 DELL  )
[    0.010980] ACPI: XSDT 0x000000006EF0E188 0000DC (v01 DELL   PE_SC3   00000002 DELL 00000001)
[    0.010990] ACPI: FACP 0x000000006EFFA000 000114 (v06 DELL   PE_SC3   00000002 DELL 00000001)
[    0.010998] ACPI: DSDT 0x000000006EF26000 0C986A (v02 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011002] ACPI: FACS 0x000000006EDAF000 000040
[    0.011006] ACPI: BERT 0x000000006EFFC000 000030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.011009] ACPI: HEST 0x000000006EFFB000 0008D4 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.011013] ACPI: HPET 0x000000006EFF9000 000038 (v01 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011017] ACPI: APIC 0x000000006EFF2000 0060BE (v05 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011021] ACPI: MCFG 0x000000006EFF1000 00003C (v01 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011024] ACPI: WSMT 0x000000006EFF0000 000028 (v01 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011028] ACPI: SSDT 0x000000006EF25000 000513 (v02 DELL   xhc_port 00000001 INTL 20210331)
[    0.011032] ACPI: SSDT 0x000000006EF23000 00111F (v02 AMD    CPMRAS   00000001 INTL 20210331)
[    0.011036] ACPI: SSDT 0x000000006EF22000 000623 (v02 DELL   Tpm2Tabl 00001000 INTL 20210331)
[    0.011040] ACPI: TPM2 0x000000006EF21000 00004C (v04 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011043] ACPI: EINJ 0x000000006EF20000 000170 (v01 AMD    PE_SC3   00000001 AMD  00000001)
[    0.011047] ACPI: ASPT 0x000000006EF1F000 000070 (v02 DELL   AmdTable 00000001 AMD  00000001)
[    0.011050] ACPI: SSDT 0x000000006EF16000 008BE4 (v02 DELL   PE_SC3   00000001 AMD  00000001)
[    0.011054] ACPI: SRAT 0x000000006EF15000 0006D0 (v03 DELL   PE_SC3   00000001 AMD  00000001)
[    0.011058] ACPI: MSCT 0x000000006EF14000 00004E (v01 DELL   PE_SC3   00000000 AMD  00000001)
[    0.011061] ACPI: SLIT 0x000000006EF13000 000030 (v01 DELL   PE_SC3   00000001 AMD  00000001)
[    0.011065] ACPI: HMAT 0x000000006EF12000 0000E8 (v02 DELL   AmdTable 00000001 AMD  00000001)
[    0.011068] ACPI: IVRS 0x000000006EF11000 000370 (v02 DELL   PE_SC3   00000001 AMD  00000001)
[    0.011072] ACPI: SPCR 0x000000006EF10000 000050 (v02 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011075] ACPI: SSDT 0x000000006EF0F000 0008CB (v02 DELL   PE_SC3   00000002 DELL 00000001)
[    0.011079] ACPI: SSDT 0x000000006EF0C000 00193C (v02 AMD    CPMCMN   00000001 INTL 20210331)
[    0.011082] ACPI: NBFT 0x000000006EFFD000 0000F6 (v01 DELL   PE_SC3   00000000 DELL 00000001)
[    0.011085] ACPI: Reserving FACP table memory at [mem 0x6effa000-0x6effa113]
[    0.011088] ACPI: Reserving DSDT table memory at [mem 0x6ef26000-0x6efef869]
[    0.011089] ACPI: Reserving FACS table memory at [mem 0x6edaf000-0x6edaf03f]
[    0.011090] ACPI: Reserving BERT table memory at [mem 0x6effc000-0x6effc02f]
[    0.011091] ACPI: Reserving HEST table memory at [mem 0x6effb000-0x6effb8d3]
[    0.011093] ACPI: Reserving HPET table memory at [mem 0x6eff9000-0x6eff9037]
[    0.011094] ACPI: Reserving APIC table memory at [mem 0x6eff2000-0x6eff80bd]
[    0.011095] ACPI: Reserving MCFG table memory at [mem 0x6eff1000-0x6eff103b]
[    0.011096] ACPI: Reserving WSMT table memory at [mem 0x6eff0000-0x6eff0027]
[    0.011097] ACPI: Reserving SSDT table memory at [mem 0x6ef25000-0x6ef25512]
[    0.011098] ACPI: Reserving SSDT table memory at [mem 0x6ef23000-0x6ef2411e]
[    0.011099] ACPI: Reserving SSDT table memory at [mem 0x6ef22000-0x6ef22622]
[    0.011101] ACPI: Reserving TPM2 table memory at [mem 0x6ef21000-0x6ef2104b]
[    0.011102] ACPI: Reserving EINJ table memory at [mem 0x6ef20000-0x6ef2016f]
[    0.011103] ACPI: Reserving ASPT table memory at [mem 0x6ef1f000-0x6ef1f06f]
[    0.011104] ACPI: Reserving SSDT table memory at [mem 0x6ef16000-0x6ef1ebe3]
[    0.011105] ACPI: Reserving SRAT table memory at [mem 0x6ef15000-0x6ef156cf]
[    0.011106] ACPI: Reserving MSCT table memory at [mem 0x6ef14000-0x6ef1404d]
[    0.011107] ACPI: Reserving SLIT table memory at [mem 0x6ef13000-0x6ef1302f]
[    0.011108] ACPI: Reserving HMAT table memory at [mem 0x6ef12000-0x6ef120e7]
[    0.011110] ACPI: Reserving IVRS table memory at [mem 0x6ef11000-0x6ef1136f]
[    0.011111] ACPI: Reserving SPCR table memory at [mem 0x6ef10000-0x6ef1004f]
[    0.011112] ACPI: Reserving SSDT table memory at [mem 0x6ef0f000-0x6ef0f8ca]
[    0.011113] ACPI: Reserving SSDT table memory at [mem 0x6ef0c000-0x6ef0d93b]
[    0.011114] ACPI: Reserving NBFT table memory at [mem 0x6effd000-0x6effd0f5]
[    0.011255] APIC: Switched APIC routing to: cluster x2apic
[    0.011291] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff]
[    0.011295] ACPI: SRAT: Node 0 PXM 0 [mem 0x000c0000-0x7fffffff]
[    0.011297] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x207fffffff]
[    0.011298] ACPI: SRAT: Node 1 PXM 1 [mem 0x2080000000-0x407fffffff]
[    0.011302] NUMA: Initialized distance table, cnt=2
[    0.011306] NUMA: Node 0 [mem 0x00001000-0x0009ffff] + [mem 0x000c0000-0x7fffffff] -> [mem 0x00001000-0x7fffffff]
[    0.011309] NUMA: Node 0 [mem 0x00001000-0x7fffffff] + [mem 0x100000000-0x207fffffff] -> [mem 0x00001000-0x207fffffff]
[    0.011317] NODE_DATA(0) allocated [mem 0x207ebfb700-0x207ebfffff]
[    0.011321] NODE_DATA(1) allocated [mem 0x407e8ba700-0x407e8befff]
[    0.011336] crashkernel reserved: 0x0000000049000000 - 0x0000000059000000 (256 MB)
[    0.011752] Zone ranges:
[    0.011753]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.011756]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.011758]   Normal   [mem 0x0000000100000000-0x000000407e8bffff]
[    0.011760]   Device   empty
[    0.011762] Movable zone start for each node
[    0.011763] Early memory node ranges
[    0.011764]   node   0: [mem 0x0000000000001000-0x000000000008efff]
[    0.011767]   node   0: [mem 0x0000000000090000-0x000000000009ffff]
[    0.011768]   node   0: [mem 0x0000000000100000-0x0000000059cccfff]
[    0.011770]   node   0: [mem 0x0000000059cd0000-0x00000000677cefff]
[    0.011771]   node   0: [mem 0x000000006efff000-0x000000006effffff]
[    0.011772]   node   0: [mem 0x0000000100000000-0x000000207ebfffff]
[    0.011792]   node   1: [mem 0x0000002080000000-0x000000407e8bffff]
[    0.011813] Initmem setup node 0 [mem 0x0000000000001000-0x000000207ebfffff]
[    0.011819] Initmem setup node 1 [mem 0x0000002080000000-0x000000407e8bffff]
[    0.011824] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.011826] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.011849] On node 0, zone DMA: 96 pages in unavailable ranges
[    0.013958] On node 0, zone DMA32: 3 pages in unavailable ranges
[    0.014392] On node 0, zone DMA32: 30768 pages in unavailable ranges
[    0.181144] On node 0, zone Normal: 4096 pages in unavailable ranges
[    0.364226] On node 1, zone Normal: 5120 pages in unavailable ranges
[    0.364316] On node 1, zone Normal: 5952 pages in unavailable ranges
[    0.364440] ACPI: PM-Timer IO Port: 0x408
[    0.364522] ACPI: X2APIC_NMI (uid[0xffffffff] high edge lint[0x1])
[    0.364534] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.364563] IOAPIC[0]: apic_id 240, version 33, address 0xfec00000, GSI 0-23
[    0.364570] IOAPIC[1]: apic_id 241, version 33, address 0xea180000, GSI 120-151
[    0.364575] IOAPIC[2]: apic_id 242, version 33, address 0xdd180000, GSI 88-119
[    0.364580] IOAPIC[3]: apic_id 243, version 33, address 0xfd180000, GSI 24-55
[    0.364584] IOAPIC[4]: apic_id 244, version 33, address 0xd0180000, GSI 56-87
[    0.364590] IOAPIC[5]: apic_id 245, version 33, address 0xc3180000, GSI 248-279
[    0.364596] IOAPIC[6]: apic_id 246, version 33, address 0xb6180000, GSI 216-247
[    0.364602] IOAPIC[7]: apic_id 247, version 33, address 0xa9280000, GSI 152-183
[    0.364607] IOAPIC[8]: apic_id 248, version 33, address 0x9c180000, GSI 184-215
[    0.364625] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.364628] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
[    0.364671] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.364673] ACPI: HPET id: 0x10228201 base: 0xfed00000
[    0.364680] ACPI: SPCR: console: uart,io,0x2f8,115200
[    0.364690] CPU topo: Max. logical packages:   2
[    0.364692] CPU topo: Max. logical dies:      16
[    0.364693] CPU topo: Max. dies per package:   8
[    0.364701] CPU topo: Max. threads per core:   2
[    0.364703] CPU topo: Num. cores per package:    16
[    0.364704] CPU topo: Num. threads per package:  32
[    0.364705] CPU topo: Allowing 64 present CPUs plus 0 hotplug CPUs
[    0.364760] [mem 0x80000000-0xffffffff] available for PCI devices
[    0.364765] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.374554] setup_percpu: NR_CPUS:512 nr_cpumask_bits:64 nr_cpu_ids:64 nr_node_ids:2
[    0.376624] percpu: Embedded 59 pages/cpu s202008 r8192 d31464 u262144
[    0.376639] pcpu-alloc: s202008 r8192 d31464 u262144 alloc=1*2097152
[    0.376643] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.376655] pcpu-alloc: [0] 32 33 34 35 36 37 38 39 [0] 40 41 42 43 44 45 46 47 
[    0.376666] pcpu-alloc: [1] 16 17 18 19 20 21 22 23 [1] 24 25 26 27 28 29 30 31 
[    0.376676] pcpu-alloc: [1] 48 49 50 51 52 53 54 55 [1] 56 57 58 59 60 61 62 63 
[    0.376720] Kernel command line: root=LABEL=root ro crashkernel=64G-:256M console=ttyS0,115200n8 console=tty0 init=/bin/systemd audit=0 random.trust_cpu=on systemd.unified_cgroup_hierarchy
[    0.376792] audit: disabled (until reboot)
[    0.376843] random: crng init done
[    0.377312] Fallback order for Node 0: 0 1 
[    0.377316] Fallback order for Node 1: 1 0 
[    0.377324] Built 2 zonelists, mobility grouping on.  Total pages: 66997291
[    0.377326] Policy zone: Normal
[    0.377328] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[    0.377363] software IO TLB: area num 64.
[    0.830350] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=64, Nodes=2
[    0.830435] ftrace: allocating 46660 entries in 183 pages
[    0.848016] ftrace: allocated 183 pages with 6 groups
[    0.849613] Dynamic Preempt: voluntary
[    0.849827] rcu: Preemptible hierarchical RCU implementation.
[    0.849829] rcu: 	RCU event tracing is enabled.
[    0.849830] rcu: 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=64.
[    0.849832] 	Trampoline variant of Tasks RCU enabled.
[    0.849833] 	Rude variant of Tasks RCU enabled.
[    0.849834] 	Tracing variant of Tasks RCU enabled.
[    0.849835] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.849836] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=64
[    0.849864] RCU Tasks: Setting shift to 6 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=64.
[    0.849870] RCU Tasks Rude: Setting shift to 6 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=64.
[    0.849876] RCU Tasks Trace: Setting shift to 6 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=64.
[    0.856840] NR_IRQS: 33024, nr_irqs: 5288, preallocated irqs: 16
[    0.857125] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.859002] Console: colour EGA 80x25
[    0.859007] printk: legacy console [tty0] enabled
[    0.878266] printk: legacy console [ttyS0] enabled
[    2.593374] mempolicy: Disabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    2.604774] ACPI: Core revision 20240827
[    2.609509] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns
[    2.618757] APIC: Switch to symmetric I/O mode setup
[    2.625568] AMD-Vi: Using global IVHD EFR:0x25bf732fa2295afe, EFR2:0x1d
[    2.634763] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    2.645759] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3b1923270e5, max_idle_ns: 440795282815 ns
[    2.656390] Calibrating delay loop (skipped), value calculated using timer frequency.. 8199.87 BogoMIPS (lpj=4099937)
[    2.657420] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    2.659599] LVT offset 2 assigned for vector 0xf4
[    2.661447] Last level iTLB entries: 4KB 512, 2MB 512, 4MB 256
[    2.662390] Last level dTLB entries: 4KB 3072, 2MB 3072, 4MB 1536, 1GB 0
[    2.664391] process: using mwait in idle threads
[    2.665396] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    2.666393] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
[    2.667391] Spectre V2 : Mitigation: Enhanced / Automatic IBRS
[    2.668395] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    2.669396] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    2.670391] Spectre V2 : User space: Mitigation: STIBP always-on protection
[    2.671393] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[    2.672392] Speculative Return Stack Overflow: Mitigation: Safe RET
[    2.673401] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    2.674391] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    2.675390] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    2.676390] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    2.677390] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    2.679390] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    2.680392] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    2.681394] x86/fpu: Supporting XSAVE feature 0x800: 'Control-flow User registers'
[    2.682396] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    2.683390] x86/fpu: xstate_offset[5]:  832, xstate_sizes[5]:   64
[    2.684390] x86/fpu: xstate_offset[6]:  896, xstate_sizes[6]:  512
[    2.685390] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024
[    2.686390] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]:    8
[    2.687390] x86/fpu: xstate_offset[11]: 2440, xstate_sizes[11]:   16
[    2.688390] x86/fpu: Enabled xstate features 0xae7, context size is 2456 bytes, using 'compacted' format.
[    2.729974] Freeing SMP alternatives memory: 40K
[    2.730395] pid_max: default: 65536 minimum: 512
[    2.739845] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc hugepage)
[    2.745514] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc hugepage)
[    2.746597] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    2.747609] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    2.851826] smpboot: CPU0: AMD EPYC 9174F 16-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)
[    2.853414] Performance Events: Fam17h+ 16-deep LBR, core perfctr, AMD PMU driver.
[    2.854394] ... version:                2
[    2.855392] ... bit width:              48
[    2.856392] ... generic registers:      6
[    2.857392] ... value mask:             0000ffffffffffff
[    2.858392] ... max period:             00007fffffffffff
[    2.859392] ... fixed-purpose events:   0
[    2.860392] ... event mask:             000000000000003f
[    2.861672] signal: max sigframe size: 3376
[    2.863414] rcu: Hierarchical SRCU implementation.
[    2.864393] rcu: 	Max phase no-delay instances is 400.
[    2.865476] Timer migration: 3 hierarchy levels; 8 children per group; 2 crossnode level
[    2.873441] smp: Bringing up secondary CPUs ...
[    2.874622] smpboot: x86: Booting SMP configuration:
[    2.875397] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7  #8  #9 #10 #11 #12 #13 #14 #15
[    2.880396] .... node  #1, CPUs:   #16 #17 #18 #19 #20 #21 #22 #23 #24 #25 #26 #27 #28 #29 #30 #31
[    2.929392] .... node  #0, CPUs:   #32 #33 #34 #35 #36 #37 #38 #39 #40 #41 #42 #43 #44 #45 #46 #47
[    2.950395] .... node  #1, CPUs:   #48 #49 #50 #51 #52 #53 #54 #55 #56 #57 #58 #59 #60 #61 #62 #63
[    2.972494] Spectre V2 : Update user space SMT mitigation: STIBP always-on
[    3.013486] smp: Brought up 2 nodes, 64 CPUs
[    3.014395] smpboot: Total of 64 processors activated (524791.93 BogoMIPS)
[    3.021488] Memory: 263174712K/267989164K available (16384K kernel code, 3638K rwdata, 5236K rodata, 3136K init, 2844K bss, 4587264K reserved, 0K cma-reserved)
[    3.031846] devtmpfs: initialized
[    3.032478] x86/mm: Memory block size: 2048MB
[    3.042506] ACPI: PM: Registering ACPI NVS region [mem 0x0008f000-0x0008ffff] (4096 bytes)
[    3.043399] ACPI: PM: Registering ACPI NVS region [mem 0x6dfcf000-0x6edfefff] (14876672 bytes)
[    3.044687] ACPI: PM: Registering ACPI NVS region [mem 0x6f000000-0x6fffffff] (16777216 bytes)
[    3.045844] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    3.046417] futex hash table entries: 16384 (order: 8, 1048576 bytes, vmalloc)
[    3.048858] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    3.050637] thermal_sys: Registered thermal governor 'step_wise'
[    3.050640] thermal_sys: Registered thermal governor 'user_space'
[    3.051425] cpuidle: using governor menu
[    3.054452] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    3.055504] PCI: ECAM [mem 0x80000000-0x8fffffff] (base 0x80000000) for domain 0000 [bus 00-ff]
[    3.056429] PCI: Using configuration type 1 for base access
[    3.057416] PCI: Dell System detected, enabling pci=bfsort.
[    3.059480] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    3.061512] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[    3.068393] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[    3.075393] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    3.082392] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[    3.105639] raid6: avx512x4 gen() 19546 MB/s
[    3.126638] raid6: avx512x2 gen() 20381 MB/s
[    3.147639] raid6: avx512x1 gen() 19192 MB/s
[    3.168639] raid6: avx2x4   gen() 20961 MB/s
[    3.189639] raid6: avx2x2   gen() 21500 MB/s
[    3.210639] raid6: avx2x1   gen() 17726 MB/s
[    3.215400] raid6: using algorithm avx2x2 gen() 21500 MB/s
[    3.236638] raid6: .... xor() 15145 MB/s, rmw enabled
[    3.242393] raid6: using avx512x2 recovery algorithm
[    3.247626] ACPI: Added _OSI(Module Device)
[    3.251393] ACPI: Added _OSI(Processor Device)
[    3.256393] ACPI: Added _OSI(3.0 _SCP Extensions)
[    3.260393] ACPI: Added _OSI(Processor Aggregator Device)
[    3.343981] ACPI: 7 ACPI AML tables successfully acquired and loaded
[    3.386932] ACPI: Interpreter enabled
[    3.390415] ACPI: PM: (supports S0 S5)
[    3.394393] ACPI: Using IOAPIC for interrupt routing
[    3.400586] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    3.410395] PCI: Ignoring E820 reservations for host bridge windows
[    3.424614] ACPI: Enabled 2 GPEs in block 00 to 1F
[    3.528290] ACPI: PCI: Interrupt link LNKA configured for IRQ 0
[    3.534469] ACPI: PCI: Interrupt link LNKB configured for IRQ 0
[    3.540489] ACPI: PCI: Interrupt link LNKC configured for IRQ 0
[    3.546465] ACPI: PCI: Interrupt link LNKD configured for IRQ 0
[    3.552491] ACPI: PCI: Interrupt link LNKE configured for IRQ 0
[    3.558464] ACPI: PCI: Interrupt link LNKF configured for IRQ 0
[    3.565468] ACPI: PCI: Interrupt link LNKG configured for IRQ 0
[    3.571464] ACPI: PCI: Interrupt link LNKH configured for IRQ 0
[    3.577612] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-1f])
[    3.584399] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    3.593677] acpi PNP0A08:00: _OSC: OS now controls [PME PCIeCapability LTR]
[    3.600392] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    3.609438] PCI host bridge to bus 0000:00
[    3.613400] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    3.620396] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    3.627402] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000fffff window]
[    3.635398] pci_bus 0000:00: root bus resource [io  0x0d00-0x1fff window]
[    3.642395] pci_bus 0000:00: root bus resource [mem 0xeb000000-0xfebfffff window]
[    3.649393] pci_bus 0000:00: root bus resource [mem 0x2bf40000000-0x39edfffffff window]
[    3.657393] pci_bus 0000:00: root bus resource [bus 00-1f]
[    3.663439] pci 0000:00:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    3.671619] pci 0000:00:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    3.680517] pci 0000:00:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    3.690605] pci 0000:00:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    3.698498] pci 0000:00:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    3.707535] pci 0000:00:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    3.715505] pci 0000:00:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    3.724532] pci 0000:00:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    3.732492] pci 0000:00:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    3.741490] pci 0000:00:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    3.748411] pci 0000:00:07.1: PCI bridge to [bus 01]
[    3.753401] pci 0000:00:07.1:   bridge window [mem 0xf9000000-0xf92fffff]
[    3.760399] pci 0000:00:07.1:   bridge window [mem 0x2bf60200000-0x2bf602fffff 64bit pref]
[    3.769445] pci 0000:00:07.1: PME# supported from D0 D3hot D3cold
[    3.776292] pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500 conventional PCI endpoint
[    3.784541] pci 0000:00:14.3: [1022:790e] type 00 class 0x060100 conventional PCI endpoint
[    3.793439] pci 0000:00:18.0: [1022:14ad] type 00 class 0x060000 conventional PCI endpoint
[    3.802493] pci 0000:00:18.1: [1022:14ae] type 00 class 0x060000 conventional PCI endpoint
[    3.810393] pci 0000:00:18.2: [1022:14af] type 00 class 0x060000 conventional PCI endpoint
[    3.819482] pci 0000:00:18.3: [1022:14b0] type 00 class 0x060000 conventional PCI endpoint
[    3.827477] pci 0000:00:18.4: [1022:14b1] type 00 class 0x060000 conventional PCI endpoint
[    3.835477] pci 0000:00:18.5: [1022:14b2] type 00 class 0x060000 conventional PCI endpoint
[    3.844474] pci 0000:00:18.6: [1022:14b3] type 00 class 0x060000 conventional PCI endpoint
[    3.857475] pci 0000:00:18.7: [1022:14b4] type 00 class 0x060000 conventional PCI endpoint
[    3.866480] pci 0000:00:19.0: [1022:14ad] type 00 class 0x060000 conventional PCI endpoint
[    3.874529] pci 0000:00:19.1: [1022:14ae] type 00 class 0x060000 conventional PCI endpoint
[    3.883502] pci 0000:00:19.2: [1022:14af] type 00 class 0x060000 conventional PCI endpoint
[    3.891520] pci 0000:00:19.3: [1022:14b0] type 00 class 0x060000 conventional PCI endpoint
[    3.900485] pci 0000:00:19.4: [1022:14b1] type 00 class 0x060000 conventional PCI endpoint
[    3.908480] pci 0000:00:19.5: [1022:14b2] type 00 class 0x060000 conventional PCI endpoint
[    3.917483] pci 0000:00:19.6: [1022:14b3] type 00 class 0x060000 conventional PCI endpoint
[    3.925483] pci 0000:00:19.7: [1022:14b4] type 00 class 0x060000 conventional PCI endpoint
[    3.934446] pci 0000:01:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    3.943164] pci 0000:01:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    3.950417] pci 0000:01:00.1: BAR 0 [mem 0x2bf60280000-0x2bf602fffff 64bit pref]
[    3.958406] pci 0000:01:00.1: BAR 2 [mem 0x2bf60200000-0x2bf6027ffff 64bit pref]
[    3.966088] pci 0000:01:00.4: [1022:14c9] type 00 class 0x0c0330 PCIe Endpoint
[    3.973409] pci 0000:01:00.4: BAR 0 [mem 0xf9000000-0xf90fffff 64bit]
[    3.980673] pci 0000:01:00.4: PME# supported from D0 D3hot D3cold
[    3.987597] pci 0000:01:00.5: [1022:14ca] type 00 class 0x108000 PCIe Endpoint
[    3.994400] pci 0000:01:00.5: BAR 2 [mem 0xf9100000-0xf91fffff]
[    4.000407] pci 0000:01:00.5: BAR 5 [mem 0xf9200000-0xf9201fff]
[    4.007011] pci 0000:00:07.1: PCI bridge to [bus 01]
[    4.013420] pci_bus 0000:00: on NUMA node 0
[    4.014126] ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 20-3f])
[    4.020403] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    4.029679] acpi PNP0A08:01: _OSC: OS now controls [PME PCIeCapability LTR]
[    4.037394] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    4.046112] PCI host bridge to bus 0000:20
[    4.050397] pci_bus 0000:20: root bus resource [io  0x2000-0x2fff window]
[    4.057398] pci_bus 0000:20: root bus resource [mem 0xc4000000-0xd0ffffff window]
[    4.065395] pci_bus 0000:20: root bus resource [mem 0x39ee0000000-0x47e7fffffff window]
[    4.073393] pci_bus 0000:20: root bus resource [bus 20-3f]
[    4.078418] pci 0000:20:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    4.087542] pci 0000:20:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    4.095466] pci 0000:20:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    4.104696] pci 0000:20:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.113488] pci 0000:20:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.121490] pci 0000:20:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.130534] pci 0000:20:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.138527] pci 0000:20:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.147495] pci 0000:20:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.155490] pci 0000:20:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    4.163409] pci 0000:20:07.1: PCI bridge to [bus 21]
[    4.168403] pci 0000:20:07.1:   bridge window [mem 0x39f00200000-0x39f002fffff 64bit pref]
[    4.176444] pci 0000:20:07.1: PME# supported from D0 D3hot D3cold
[    4.184972] pci 0000:21:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    4.193497] pci 0000:21:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    4.201406] pci 0000:21:00.1: BAR 0 [mem 0x39f00280000-0x39f002fffff 64bit pref]
[    4.208401] pci 0000:21:00.1: BAR 2 [mem 0x39f00200000-0x39f0027ffff 64bit pref]
[    4.216554] pci 0000:20:07.1: PCI bridge to [bus 21]
[    4.221458] pci_bus 0000:20: on NUMA node 0
[    4.222511] ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 40-5f])
[    4.229411] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    4.238673] acpi PNP0A08:02: _OSC: OS now controls [PME PCIeCapability LTR]
[    4.245393] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    4.254187] PCI host bridge to bus 0000:40
[    4.258399] pci_bus 0000:40: root bus resource [io  0x3000-0x3fff window]
[    4.265393] pci_bus 0000:40: root bus resource [mem 0xd1000000-0xddffffff window]
[    4.273393] pci_bus 0000:40: root bus resource [mem 0x1dfa0000000-0x2bf3fffffff window]
[    4.281394] pci_bus 0000:40: root bus resource [bus 40-5f]
[    4.286415] pci 0000:40:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    4.295556] pci 0000:40:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    4.303528] pci 0000:40:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    4.313801] pci 0000:40:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.321495] pci 0000:40:01.1: [1022:14ab] type 01 class 0x060400 PCIe Root Port
[    4.329412] pci 0000:40:01.1: PCI bridge to [bus 41]
[    4.334397] pci 0000:40:01.1:   bridge window [io  0x3000-0x3fff]
[    4.340394] pci 0000:40:01.1:   bridge window [mem 0xda000000-0xda0fffff]
[    4.347399] pci 0000:40:01.1:   bridge window [mem 0xd1000000-0xd11fffff 64bit pref]
[    4.355477] pci 0000:40:01.1: PME# supported from D0 D3hot D3cold
[    4.363263] pci 0000:40:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.371494] pci 0000:40:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.380536] pci 0000:40:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.388502] pci 0000:40:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.397523] pci 0000:40:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.405491] pci 0000:40:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    4.413413] pci 0000:40:07.1: PCI bridge to [bus 42]
[    4.418403] pci 0000:40:07.1:   bridge window [mem 0x1dfc0200000-0x1dfc02fffff 64bit pref]
[    4.426434] pci 0000:40:07.1: PME# supported from D0 D3hot D3cold
[    4.434001] pci 0000:41:00.0: [1000:00e6] type 00 class 0x010700 PCIe Endpoint
[    4.441408] pci 0000:41:00.0: BAR 0 [mem 0xd1000000-0xd10fffff 64bit pref]
[    4.448403] pci 0000:41:00.0: BAR 2 [mem 0xd1100000-0xd11fffff 64bit pref]
[    4.455399] pci 0000:41:00.0: BAR 4 [mem 0xda000000-0xda0fffff]
[    4.461409] pci 0000:41:00.0: BAR 5 [io  0x3000-0x30ff]
[    4.466404] pci 0000:41:00.0: ROM [mem 0xfffc0000-0xffffffff pref]
[    4.474186] pci 0000:41:00.0: supports D1 D2
[    4.478616] pci 0000:40:01.1: PCI bridge to [bus 41]
[    4.484486] pci 0000:42:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    4.492372] pci 0000:42:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    4.500402] pci 0000:42:00.1: BAR 0 [mem 0x1dfc0280000-0x1dfc02fffff 64bit pref]
[    4.507400] pci 0000:42:00.1: BAR 2 [mem 0x1dfc0200000-0x1dfc027ffff 64bit pref]
[    4.516010] pci 0000:40:07.1: PCI bridge to [bus 42]
[    4.521451] pci_bus 0000:40: on NUMA node 0
[    4.522396] ACPI: PCI Root Bridge [PC03] (domain 0000 [bus 60-7f])
[    4.528407] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    4.537679] acpi PNP0A08:03: _OSC: OS now controls [PME PCIeCapability LTR]
[    4.545396] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    4.554215] PCI host bridge to bus 0000:60
[    4.558411] pci_bus 0000:60: root bus resource [io  0x4000-0x4fff window]
[    4.565393] pci_bus 0000:60: root bus resource [mem 0xde000000-0xeaffffff window]
[    4.573393] pci_bus 0000:60: root bus resource [mem 0x10000000000-0x1df9fffffff window]
[    4.581393] pci_bus 0000:60: root bus resource [io  0x03b0-0x03df window]
[    4.588393] pci_bus 0000:60: root bus resource [mem 0x000a0000-0x000bffff window]
[    4.595393] pci_bus 0000:60: root bus resource [bus 60-7f]
[    4.601418] pci 0000:60:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    4.609546] pci 0000:60:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    4.618515] pci 0000:60:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    4.627636] pci 0000:60:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.635536] pci 0000:60:01.1: [1022:14ab] type 01 class 0x060400 PCIe Root Port
[    4.643422] pci 0000:60:01.1: PCI bridge to [bus 64]
[    4.648398] pci 0000:60:01.1:   bridge window [mem 0xe2100000-0xe22fffff]
[    4.655401] pci 0000:60:01.1:   bridge window [mem 0xde000000-0xe20fffff 64bit pref]
[    4.663483] pci 0000:60:01.1: PME# supported from D0 D3hot D3cold
[    4.671790] pci 0000:60:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.680491] pci 0000:60:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.688485] pci 0000:60:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.702490] pci 0000:60:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.710500] pci 0000:60:05.2: [1022:14aa] type 01 class 0x060400 PCIe Root Port
[    4.718419] pci 0000:60:05.2: PCI bridge to [bus 61-62]
[    4.723399] pci 0000:60:05.2:   bridge window [mem 0xe7000000-0xe78fffff]
[    4.730405] pci 0000:60:05.2:   bridge window [mem 0xe3000000-0xe3ffffff 64bit pref]
[    4.738474] pci 0000:60:05.2: PME# supported from D0 D3hot D3cold
[    4.745712] pci 0000:60:05.3: [1022:14aa] type 01 class 0x060400 PCIe Root Port
[    4.753413] pci 0000:60:05.3: PCI bridge to [bus 63]
[    4.758401] pci 0000:60:05.3:   bridge window [mem 0xe2300000-0xe23fffff]
[    4.765399] pci 0000:60:05.3:   bridge window [mem 0xe4100000-0xe41fffff 64bit pref]
[    4.773458] pci 0000:60:05.3: PME# supported from D0 D3hot D3cold
[    4.780332] pci 0000:60:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    4.788498] pci 0000:60:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    4.796416] pci 0000:60:07.1: PCI bridge to [bus 65]
[    4.801400] pci 0000:60:07.1:   bridge window [mem 0xe7a00000-0xe7afffff]
[    4.808404] pci 0000:60:07.1:   bridge window [mem 0xe4000000-0xe40fffff 64bit pref]
[    4.816462] pci 0000:60:07.1: PME# supported from D0 D3hot D3cold
[    4.823554] pci 0000:60:07.2: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    4.831411] pci 0000:60:07.2: PCI bridge to [bus 66]
[    4.836397] pci 0000:60:07.2:   bridge window [mem 0xe7900000-0xe79fffff]
[    4.843447] pci 0000:60:07.2: PME# supported from D0 D3hot D3cold
[    4.850396] pci 0000:64:00.0: [8086:159b] type 00 class 0x020000 PCIe Endpoint
[    4.857408] pci 0000:64:00.0: BAR 0 [mem 0xe0000000-0xe1ffffff 64bit pref]
[    4.864409] pci 0000:64:00.0: BAR 3 [mem 0xe2010000-0xe201ffff 64bit pref]
[    4.871406] pci 0000:64:00.0: ROM [mem 0xfff00000-0xffffffff pref]
[    4.879405] pci 0000:64:00.1: [8086:159b] type 00 class 0x020000 PCIe Endpoint
[    4.887418] pci 0000:64:00.1: BAR 0 [mem 0xde000000-0xdfffffff 64bit pref]
[    4.893415] pci 0000:64:00.1: BAR 3 [mem 0xe2000000-0xe200ffff 64bit pref]
[    4.900408] pci 0000:64:00.1: ROM [mem 0xfff00000-0xffffffff pref]
[    4.907805] pci 0000:60:01.1: PCI bridge to [bus 64]
[    4.913721] pci 0000:61:00.0: [1556:be00] type 01 class 0x060400 PCIe to PCI/PCI-X bridge
[    4.921426] pci 0000:61:00.0: PCI bridge to [bus 62]
[    4.926401] pci 0000:61:00.0:   bridge window [mem 0xe7000000-0xe78fffff]
[    4.933402] pci 0000:61:00.0:   bridge window [mem 0xe3000000-0xe3ffffff 64bit pref]
[    4.942597] pci 0000:60:05.2: PCI bridge to [bus 61-62]
[    4.948430] pci_bus 0000:62: extended config space not accessible
[    4.954429] pci 0000:62:00.0: [102b:0536] type 00 class 0x030000 conventional PCI endpoint
[    4.962410] pci 0000:62:00.0: BAR 0 [mem 0xe3000000-0xe3ffffff pref]
[    4.969409] pci 0000:62:00.0: BAR 1 [mem 0xe7808000-0xe780bfff]
[    4.975405] pci 0000:62:00.0: BAR 2 [mem 0xe7000000-0xe77fffff]
[    4.981432] pci 0000:62:00.0: ROM [mem 0x00000000-0x0000ffff pref]
[    4.987884] pci 0000:62:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    4.996612] pci 0000:61:00.0: PCI bridge to [bus 62]
[    5.002469] pci 0000:63:00.0: [14e4:165f] type 00 class 0x020000 PCIe Endpoint
[    5.009416] pci 0000:63:00.0: BAR 0 [mem 0xe4130000-0xe413ffff 64bit pref]
[    5.016405] pci 0000:63:00.0: BAR 2 [mem 0xe4140000-0xe414ffff 64bit pref]
[    5.023405] pci 0000:63:00.0: BAR 4 [mem 0xe4150000-0xe415ffff 64bit pref]
[    5.030401] pci 0000:63:00.0: ROM [mem 0xfffc0000-0xffffffff pref]
[    5.037670] pci 0000:63:00.0: PME# supported from D0 D3hot D3cold
[    5.044433] pci 0000:63:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x1 link at 0000:60:05.3 (capable of 8.000 Gb/s with 5.0 GT/s PCIe x2 link)
[    5.060048] pci 0000:63:00.1: [14e4:165f] type 00 class 0x020000 PCIe Endpoint
[    5.067415] pci 0000:63:00.1: BAR 0 [mem 0xe4100000-0xe410ffff 64bit pref]
[    5.074396] pci 0000:63:00.1: BAR 2 [mem 0xe4110000-0xe411ffff 64bit pref]
[    5.081406] pci 0000:63:00.1: BAR 4 [mem 0xe4120000-0xe412ffff 64bit pref]
[    5.088401] pci 0000:63:00.1: ROM [mem 0xfffc0000-0xffffffff pref]
[    5.095020] pci 0000:63:00.1: PME# supported from D0 D3hot D3cold
[    5.102490] pci 0000:60:05.3: PCI bridge to [bus 63]
[    5.107880] pci 0000:65:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    5.116633] pci 0000:65:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    5.124406] pci 0000:65:00.1: BAR 0 [mem 0xe4000000-0xe407ffff 64bit pref]
[    5.131401] pci 0000:65:00.1: BAR 2 [mem 0xe4080000-0xe40fffff 64bit pref]
[    5.138612] pci 0000:65:00.4: [1022:14c9] type 00 class 0x0c0330 PCIe Endpoint
[    5.146420] pci 0000:65:00.4: BAR 0 [mem 0xe7a00000-0xe7afffff 64bit]
[    5.152938] pci 0000:65:00.4: PME# supported from D0 D3hot D3cold
[    5.159412] pci 0000:60:07.1: PCI bridge to [bus 65]
[    5.165294] pci 0000:66:00.0: [1022:7901] type 00 class 0x010601 PCIe Endpoint
[    5.173422] pci 0000:66:00.0: BAR 5 [mem 0xe7900000-0xe79007ff]
[    5.179773] pci 0000:66:00.0: PME# supported from D3hot D3cold
[    5.186513] pci 0000:60:07.2: PCI bridge to [bus 66]
[    5.191549] pci_bus 0000:60: on NUMA node 0
[    5.191853] ACPI: PCI Root Bridge [PC04] (domain 0000 [bus 80-9f])
[    5.198413] acpi PNP0A08:04: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    5.207583] acpi PNP0A08:04: _OSC: OS now controls [PME PCIeCapability LTR]
[    5.214396] acpi PNP0A08:04: FADT indicates ASPM is unsupported, using BIOS configuration
[    5.223722] PCI host bridge to bus 0000:80
[    5.228401] pci_bus 0000:80: root bus resource [io  0x5000-0x5fff window]
[    5.235396] pci_bus 0000:80: root bus resource [mem 0x9d000000-0xa9ffffff window]
[    5.242391] pci_bus 0000:80: root bus resource [mem 0x63dc0000000-0x71d5fffffff window]
[    5.250396] pci_bus 0000:80: root bus resource [bus 80-9f]
[    5.256419] pci 0000:80:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    5.264555] pci 0000:80:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    5.273527] pci 0000:80:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    5.282501] pci 0000:80:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.291505] pci 0000:80:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.299463] pci 0000:80:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.308555] pci 0000:80:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.316522] pci 0000:80:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.325503] pci 0000:80:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.333472] pci 0000:80:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    5.341413] pci 0000:80:07.1: PCI bridge to [bus 81]
[    5.346399] pci 0000:80:07.1:   bridge window [mem 0xa6000000-0xa61fffff]
[    5.353400] pci 0000:80:07.1:   bridge window [mem 0x63de0200000-0x63de02fffff 64bit pref]
[    5.361455] pci 0000:80:07.1: PME# supported from D0 D3hot D3cold
[    5.370453] pci 0000:81:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    5.378898] pci 0000:81:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    5.386418] pci 0000:81:00.1: BAR 0 [mem 0x63de0280000-0x63de02fffff 64bit pref]
[    5.394402] pci 0000:81:00.1: BAR 2 [mem 0x63de0200000-0x63de027ffff 64bit pref]
[    5.402017] pci 0000:81:00.5: [1022:14ca] type 00 class 0x108000 PCIe Endpoint
[    5.409423] pci 0000:81:00.5: BAR 2 [mem 0xa6000000-0xa60fffff]
[    5.415402] pci 0000:81:00.5: BAR 5 [mem 0xa6100000-0xa6101fff]
[    5.422032] pci 0000:80:07.1: PCI bridge to [bus 81]
[    5.428421] pci_bus 0000:80: on NUMA node 1
[    5.428570] ACPI: PCI Root Bridge [PC05] (domain 0000 [bus a0-bf])
[    5.435403] acpi PNP0A08:05: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    5.444681] acpi PNP0A08:05: _OSC: OS now controls [PME PCIeCapability LTR]
[    5.451395] acpi PNP0A08:05: FADT indicates ASPM is unsupported, using BIOS configuration
[    5.460173] PCI host bridge to bus 0000:a0
[    5.464396] pci_bus 0000:a0: root bus resource [io  0x6000-0x6fff window]
[    5.471399] pci_bus 0000:a0: root bus resource [mem 0x90000000-0x9cffffff window]
[    5.479403] pci_bus 0000:a0: root bus resource [mem 0x71d60000000-0x7fcffffffff window]
[    5.487396] pci_bus 0000:a0: root bus resource [bus a0-bf]
[    5.493424] pci 0000:a0:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    5.501568] pci 0000:a0:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    5.509528] pci 0000:a0:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    5.519599] pci 0000:a0:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.528498] pci 0000:a0:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.536492] pci 0000:a0:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.545505] pci 0000:a0:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.553555] pci 0000:a0:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.562506] pci 0000:a0:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.570534] pci 0000:a0:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    5.578413] pci 0000:a0:07.1: PCI bridge to [bus a1]
[    5.583413] pci 0000:a0:07.1:   bridge window [mem 0x71d80200000-0x71d802fffff 64bit pref]
[    5.596454] pci 0000:a0:07.1: PME# supported from D0 D3hot D3cold
[    5.605453] pci 0000:a1:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    5.614110] pci 0000:a1:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    5.621411] pci 0000:a1:00.1: BAR 0 [mem 0x71d80280000-0x71d802fffff 64bit pref]
[    5.629402] pci 0000:a1:00.1: BAR 2 [mem 0x71d80200000-0x71d8027ffff 64bit pref]
[    5.637129] pci 0000:a0:07.1: PCI bridge to [bus a1]
[    5.642445] pci_bus 0000:a0: on NUMA node 1
[    5.643091] ACPI: PCI Root Bridge [PC06] (domain 0000 [bus c0-df])
[    5.649415] acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    5.658702] acpi PNP0A08:06: _OSC: OS now controls [PME PCIeCapability LTR]
[    5.666396] acpi PNP0A08:06: FADT indicates ASPM is unsupported, using BIOS configuration
[    5.675059] PCI host bridge to bus 0000:c0
[    5.679397] pci_bus 0000:c0: root bus resource [io  0x7000-0x7fff window]
[    5.686393] pci_bus 0000:c0: root bus resource [mem 0xaa000000-0xb6ffffff window]
[    5.693395] pci_bus 0000:c0: root bus resource [mem 0x55e20000000-0x63dbfffffff window]
[    5.702394] pci_bus 0000:c0: root bus resource [bus c0-df]
[    5.707401] pci 0000:c0:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    5.716537] pci 0000:c0:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    5.724456] pci 0000:c0:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    5.733912] pci 0000:c0:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.742501] pci 0000:c0:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.751495] pci 0000:c0:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.759454] pci 0000:c0:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.768495] pci 0000:c0:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.776494] pci 0000:c0:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.785498] pci 0000:c0:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    5.792414] pci 0000:c0:07.1: PCI bridge to [bus c1]
[    5.797405] pci 0000:c0:07.1:   bridge window [mem 0x55e40200000-0x55e402fffff 64bit pref]
[    5.805472] pci 0000:c0:07.1: PME# supported from D0 D3hot D3cold
[    5.814108] pci 0000:c1:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    5.822725] pci 0000:c1:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    5.830407] pci 0000:c1:00.1: BAR 0 [mem 0x55e40280000-0x55e402fffff 64bit pref]
[    5.837401] pci 0000:c1:00.1: BAR 2 [mem 0x55e40200000-0x55e4027ffff 64bit pref]
[    5.845732] pci 0000:c0:07.1: PCI bridge to [bus c1]
[    5.851451] pci_bus 0000:c0: on NUMA node 1
[    5.851634] ACPI: PCI Root Bridge [PC07] (domain 0000 [bus e0-ff])
[    5.858408] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    5.867673] acpi PNP0A08:07: _OSC: OS now controls [PME PCIeCapability LTR]
[    5.874394] acpi PNP0A08:07: FADT indicates ASPM is unsupported, using BIOS configuration
[    5.883170] PCI host bridge to bus 0000:e0
[    5.887403] pci_bus 0000:e0: root bus resource [mem 0xb7000000-0xc3ffffff window]
[    5.895396] pci_bus 0000:e0: root bus resource [mem 0x47e80000000-0x55e1fffffff window]
[    5.903399] pci_bus 0000:e0: root bus resource [bus e0-ff]
[    5.909423] pci 0000:e0:00.0: [1022:14a4] type 00 class 0x060000 conventional PCI endpoint
[    5.917419] pci 0000:e0:00.2: [1022:149e] type 00 class 0x080600 conventional PCI endpoint
[    5.926529] pci 0000:e0:00.3: [1022:14a6] type 00 class 0x080700 PCIe Root Complex Event Collector
[    5.935655] pci 0000:e0:01.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.943497] pci 0000:e0:02.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.952493] pci 0000:e0:03.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.960499] pci 0000:e0:04.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.969501] pci 0000:e0:05.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.977544] pci 0000:e0:07.0: [1022:149f] type 00 class 0x060000 conventional PCI endpoint
[    5.986545] pci 0000:e0:07.1: [1022:14a7] type 01 class 0x060400 PCIe Root Port
[    5.993414] pci 0000:e0:07.1: PCI bridge to [bus e1]
[    5.998405] pci 0000:e0:07.1:   bridge window [mem 0x47ea0200000-0x47ea02fffff 64bit pref]
[    6.007457] pci 0000:e0:07.1: PME# supported from D0 D3hot D3cold
[    6.015180] pci 0000:e1:00.0: [1022:14ac] type 00 class 0x130000 PCIe Endpoint
[    6.023738] pci 0000:e1:00.1: [1022:14dc] type 00 class 0x088000 PCIe Endpoint
[    6.031406] pci 0000:e1:00.1: BAR 0 [mem 0x47ea0280000-0x47ea02fffff 64bit pref]
[    6.038402] pci 0000:e1:00.1: BAR 2 [mem 0x47ea0200000-0x47ea027ffff 64bit pref]
[    6.046742] pci 0000:e0:07.1: PCI bridge to [bus e1]
[    6.052452] pci_bus 0000:e0: on NUMA node 1
[    6.081071] iommu: Default domain type: Translated
[    6.086393] iommu: DMA domain TLB invalidation policy: lazy mode
[    6.092598] SCSI subsystem initialized
[    6.096442] libata version 3.00 loaded.
[    6.096442] ACPI: bus type USB registered
[    6.100420] usbcore: registered new interface driver usbfs
[    6.106403] usbcore: registered new interface driver hub
[    6.111419] usbcore: registered new device driver usb
[    6.116418] mc: Linux media interface: v0.10
[    6.121408] videodev: Linux video capture interface: v2.00
[    6.126403] pps_core: LinuxPPS API ver. 1 registered
[    6.131392] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    6.141414] PTP clock support registered
[    6.145501] efivars: Registered efivars operations
[    6.150742] PCI: Using ACPI for IRQ routing
[    6.159784] PCI: pci_cache_line_size set to 64 bytes
[    6.160028] e820: reserve RAM buffer [mem 0x0008f000-0x0008ffff]
[    6.160034] e820: reserve RAM buffer [mem 0x59ccd000-0x5bffffff]
[    6.160037] e820: reserve RAM buffer [mem 0x677cf000-0x67ffffff]
[    6.160041] e820: reserve RAM buffer [mem 0x6f000000-0x6fffffff]
[    6.160044] e820: reserve RAM buffer [mem 0x207ec00000-0x207fffffff]
[    6.160047] e820: reserve RAM buffer [mem 0x407e8c0000-0x407fffffff]
[    6.160528] pci 0000:62:00.0: vgaarb: setting as boot VGA device
[    6.161389] pci 0000:62:00.0: vgaarb: bridge control possible
[    6.161389] pci 0000:62:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    6.181419] vgaarb: loaded
[    6.184448] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    6.189393] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    6.197741] clocksource: Switched to clocksource tsc-early
[    6.203307] VFS: Disk quotas dquot_6.6.0
[    6.207331] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    6.214451] pnp: PnP ACPI init
[    6.217959] system 00:00: [mem 0x80000000-0x8fffffff] has been reserved
[    6.224927] system 00:01: [mem 0xff000000-0xffffffff] has been reserved
[    6.235192] pnp: PnP ACPI: found 5 devices
[    6.247083] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    6.256131] NET: Registered PF_INET protocol family
[    6.261352] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    6.274003] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    6.283170] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, vmalloc)
[    6.291130] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc hugepage)
[    6.301085] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    6.308895] TCP: Hash tables configured (established 524288 bind 65536)
[    6.315786] UDP hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    6.323310] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    6.331316] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    6.337078] pci 0000:41:00.0: ROM [mem 0xfffc0000-0xffffffff pref]: can't claim; no compatible bridge window
[    6.347013] pci 0000:64:00.0: ROM [mem 0xfff00000-0xffffffff pref]: can't claim; no compatible bridge window
[    6.356943] pci 0000:64:00.1: ROM [mem 0xfff00000-0xffffffff pref]: can't claim; no compatible bridge window
[    6.366876] pci 0000:63:00.0: ROM [mem 0xfffc0000-0xffffffff pref]: can't claim; no compatible bridge window
[    6.376817] pci 0000:63:00.1: ROM [mem 0xfffc0000-0xffffffff pref]: can't claim; no compatible bridge window
[    6.386765] pci 0000:00:07.1: PCI bridge to [bus 01]
[    6.391855] pci 0000:00:07.1:   bridge window [mem 0xf9000000-0xf92fffff]
[    6.398742] pci 0000:00:07.1:   bridge window [mem 0x2bf60200000-0x2bf602fffff 64bit pref]
[    6.407559] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    6.413834] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    6.420098] pci_bus 0000:00: resource 6 [mem 0x000c0000-0x000fffff window]
[    6.427058] pci_bus 0000:00: resource 7 [io  0x0d00-0x1fff window]
[    6.433327] pci_bus 0000:00: resource 8 [mem 0xeb000000-0xfebfffff window]
[    6.440289] pci_bus 0000:00: resource 9 [mem 0x2bf40000000-0x39edfffffff window]
[    6.447781] pci_bus 0000:01: resource 1 [mem 0xf9000000-0xf92fffff]
[    6.454136] pci_bus 0000:01: resource 2 [mem 0x2bf60200000-0x2bf602fffff 64bit pref]
[    6.462085] pci 0000:20:07.1: PCI bridge to [bus 21]
[    6.467165] pci 0000:20:07.1:   bridge window [mem 0x39f00200000-0x39f002fffff 64bit pref]
[    6.476368] pci_bus 0000:20: resource 4 [io  0x2000-0x2fff window]
[    6.482643] pci_bus 0000:20: resource 5 [mem 0xc4000000-0xd0ffffff window]
[    6.489628] pci_bus 0000:20: resource 6 [mem 0x39ee0000000-0x47e7fffffff window]
[    6.497133] pci_bus 0000:21: resource 2 [mem 0x39f00200000-0x39f002fffff 64bit pref]
[    6.510077] pci 0000:41:00.0: ROM [mem size 0x00040000 pref]: can't assign; no space
[    6.517937] pci 0000:41:00.0: ROM [mem size 0x00040000 pref]: failed to assign
[    6.525245] pci 0000:40:01.1: PCI bridge to [bus 41]
[    6.530281] pci 0000:40:01.1:   bridge window [io  0x3000-0x3fff]
[    6.536452] pci 0000:40:01.1:   bridge window [mem 0xda000000-0xda0fffff]
[    6.543315] pci 0000:40:01.1:   bridge window [mem 0xd1000000-0xd11fffff 64bit pref]
[    6.551160] pci 0000:40:07.1: PCI bridge to [bus 42]
[    6.556198] pci 0000:40:07.1:   bridge window [mem 0x1dfc0200000-0x1dfc02fffff 64bit pref]
[    6.564581] pci_bus 0000:40: resource 4 [io  0x3000-0x3fff window]
[    6.570855] pci_bus 0000:40: resource 5 [mem 0xd1000000-0xddffffff window]
[    6.577819] pci_bus 0000:40: resource 6 [mem 0x1dfa0000000-0x2bf3fffffff window]
[    6.585309] pci_bus 0000:41: resource 0 [io  0x3000-0x3fff]
[    6.590955] pci_bus 0000:41: resource 1 [mem 0xda000000-0xda0fffff]
[    6.597292] pci_bus 0000:41: resource 2 [mem 0xd1000000-0xd11fffff 64bit pref]
[    6.604599] pci_bus 0000:42: resource 2 [mem 0x1dfc0200000-0x1dfc02fffff 64bit pref]
[    6.612456] pci 0000:64:00.0: ROM [mem 0xe2100000-0xe21fffff pref]: assigned
[    6.619580] pci 0000:64:00.1: ROM [mem 0xe2200000-0xe22fffff pref]: assigned
[    6.626703] pci 0000:60:01.1: PCI bridge to [bus 64]
[    6.631743] pci 0000:60:01.1:   bridge window [mem 0xe2100000-0xe22fffff]
[    6.638604] pci 0000:60:01.1:   bridge window [mem 0xde000000-0xe20fffff 64bit pref]
[    6.646476] pci 0000:61:00.0: PCI bridge to [bus 62]
[    6.651530] pci 0000:61:00.0:   bridge window [mem 0xe7000000-0xe78fffff]
[    6.658406] pci 0000:61:00.0:   bridge window [mem 0xe3000000-0xe3ffffff 64bit pref]
[    6.666247] pci 0000:60:05.2: PCI bridge to [bus 61-62]
[    6.671546] pci 0000:60:05.2:   bridge window [mem 0xe7000000-0xe78fffff]
[    6.678410] pci 0000:60:05.2:   bridge window [mem 0xe3000000-0xe3ffffff 64bit pref]
[    6.686597] pci 0000:63:00.0: ROM [mem 0xe2300000-0xe233ffff pref]: assigned
[    6.693716] pci 0000:63:00.1: ROM [mem 0xe2340000-0xe237ffff pref]: assigned
[    6.700840] pci 0000:60:05.3: PCI bridge to [bus 63]
[    6.705873] pci 0000:60:05.3:   bridge window [mem 0xe2300000-0xe23fffff]
[    6.712732] pci 0000:60:05.3:   bridge window [mem 0xe4100000-0xe41fffff 64bit pref]
[    6.721000] pci 0000:60:07.1: PCI bridge to [bus 65]
[    6.726051] pci 0000:60:07.1:   bridge window [mem 0xe7a00000-0xe7afffff]
[    6.732921] pci 0000:60:07.1:   bridge window [mem 0xe4000000-0xe40fffff 64bit pref]
[    6.740782] pci 0000:60:07.2: PCI bridge to [bus 66]
[    6.745832] pci 0000:60:07.2:   bridge window [mem 0xe7900000-0xe79fffff]
[    6.753500] pci_bus 0000:60: resource 4 [io  0x4000-0x4fff window]
[    6.759762] pci_bus 0000:60: resource 5 [mem 0xde000000-0xeaffffff window]
[    6.766708] pci_bus 0000:60: resource 6 [mem 0x10000000000-0x1df9fffffff window]
[    6.774186] pci_bus 0000:60: resource 7 [io  0x03b0-0x03df window]
[    6.780439] pci_bus 0000:60: resource 8 [mem 0x000a0000-0x000bffff window]
[    6.787390] pci_bus 0000:64: resource 1 [mem 0xe2100000-0xe22fffff]
[    6.793733] pci_bus 0000:64: resource 2 [mem 0xde000000-0xe20fffff 64bit pref]
[    6.801038] pci_bus 0000:61: resource 1 [mem 0xe7000000-0xe78fffff]
[    6.807373] pci_bus 0000:61: resource 2 [mem 0xe3000000-0xe3ffffff 64bit pref]
[    6.814699] pci_bus 0000:62: resource 1 [mem 0xe7000000-0xe78fffff]
[    6.821055] pci_bus 0000:62: resource 2 [mem 0xe3000000-0xe3ffffff 64bit pref]
[    6.828379] pci_bus 0000:63: resource 1 [mem 0xe2300000-0xe23fffff]
[    6.834729] pci_bus 0000:63: resource 2 [mem 0xe4100000-0xe41fffff 64bit pref]
[    6.842034] pci_bus 0000:65: resource 1 [mem 0xe7a00000-0xe7afffff]
[    6.848373] pci_bus 0000:65: resource 2 [mem 0xe4000000-0xe40fffff 64bit pref]
[    6.855677] pci_bus 0000:66: resource 1 [mem 0xe7900000-0xe79fffff]
[    6.862056] pci 0000:80:07.1: PCI bridge to [bus 81]
[    6.867092] pci 0000:80:07.1:   bridge window [mem 0xa6000000-0xa61fffff]
[    6.873956] pci 0000:80:07.1:   bridge window [mem 0x63de0200000-0x63de02fffff 64bit pref]
[    6.882951] pci_bus 0000:80: resource 4 [io  0x5000-0x5fff window]
[    6.889203] pci_bus 0000:80: resource 5 [mem 0x9d000000-0xa9ffffff window]
[    6.896168] pci_bus 0000:80: resource 6 [mem 0x63dc0000000-0x71d5fffffff window]
[    6.903659] pci_bus 0000:81: resource 1 [mem 0xa6000000-0xa61fffff]
[    6.910015] pci_bus 0000:81: resource 2 [mem 0x63de0200000-0x63de02fffff 64bit pref]
[    6.917889] pci 0000:a0:07.1: PCI bridge to [bus a1]
[    6.922928] pci 0000:a0:07.1:   bridge window [mem 0x71d80200000-0x71d802fffff 64bit pref]
[    6.931293] pci_bus 0000:a0: resource 4 [io  0x6000-0x6fff window]
[    6.937547] pci_bus 0000:a0: resource 5 [mem 0x90000000-0x9cffffff window]
[    6.944495] pci_bus 0000:a0: resource 6 [mem 0x71d60000000-0x7fcffffffff window]
[    6.951973] pci_bus 0000:a1: resource 2 [mem 0x71d80200000-0x71d802fffff 64bit pref]
[    6.959819] pci 0000:c0:07.1: PCI bridge to [bus c1]
[    6.964861] pci 0000:c0:07.1:   bridge window [mem 0x55e40200000-0x55e402fffff 64bit pref]
[    6.973225] pci_bus 0000:c0: resource 4 [io  0x7000-0x7fff window]
[    6.979492] pci_bus 0000:c0: resource 5 [mem 0xaa000000-0xb6ffffff window]
[    6.986448] pci_bus 0000:c0: resource 6 [mem 0x55e20000000-0x63dbfffffff window]
[    6.993954] pci_bus 0000:c1: resource 2 [mem 0x55e40200000-0x55e402fffff 64bit pref]
[    7.001824] pci 0000:e0:07.1: PCI bridge to [bus e1]
[    7.006866] pci 0000:e0:07.1:   bridge window [mem 0x47ea0200000-0x47ea02fffff 64bit pref]
[    7.015236] pci_bus 0000:e0: resource 4 [mem 0xb7000000-0xc3ffffff window]
[    7.022185] pci_bus 0000:e0: resource 5 [mem 0x47e80000000-0x55e1fffffff window]
[    7.029665] pci_bus 0000:e1: resource 2 [mem 0x47ea0200000-0x47ea02fffff 64bit pref]
[    7.038029] PCI: CLS 64 bytes, default 64
[    7.042149] pci 0000:60:00.2: AMD-Vi: IOMMU performance counters supported
[    7.042386] Trying to unpack rootfs image as initramfs...
[    7.049557] pci 0000:60:00.3: Adding to iommu group 0
[    7.059852] pci 0000:60:01.0: Adding to iommu group 1
[    7.065085] pci 0000:60:01.1: Adding to iommu group 2
[    7.070333] pci 0000:60:02.0: Adding to iommu group 3
[    7.075598] pci 0000:60:03.0: Adding to iommu group 4
[    7.080836] pci 0000:60:04.0: Adding to iommu group 5
[    7.086082] pci 0000:60:05.0: Adding to iommu group 6
[    7.091279] pci 0000:60:05.2: Adding to iommu group 7
[    7.096475] pci 0000:60:05.3: Adding to iommu group 8
[    7.101785] pci 0000:60:07.0: Adding to iommu group 9
[    7.106997] pci 0000:60:07.1: Adding to iommu group 9
[    7.112208] pci 0000:60:07.2: Adding to iommu group 9
[    7.117406] pci 0000:61:00.0: Adding to iommu group 10
[    7.122633] pci 0000:62:00.0: Adding to iommu group 10
[    7.127994] pci 0000:63:00.0: Adding to iommu group 11
[    7.133304] pci 0000:63:00.1: Adding to iommu group 11
[    7.138590] pci 0000:64:00.0: Adding to iommu group 12
[    7.143870] pci 0000:64:00.1: Adding to iommu group 13
[    7.149125] pci 0000:65:00.0: Adding to iommu group 9
[    7.154281] pci 0000:65:00.1: Adding to iommu group 9
[    7.159452] pci 0000:65:00.4: Adding to iommu group 9
[    7.164597] pci 0000:66:00.0: Adding to iommu group 9
[    7.173088] pci 0000:40:00.2: AMD-Vi: IOMMU performance counters supported
[    7.180346] pci 0000:40:00.3: Adding to iommu group 14
[    7.185668] pci 0000:40:01.0: Adding to iommu group 15
[    7.190942] pci 0000:40:01.1: Adding to iommu group 16
[    7.196267] pci 0000:40:02.0: Adding to iommu group 17
[    7.201585] pci 0000:40:03.0: Adding to iommu group 18
[    7.206908] pci 0000:40:04.0: Adding to iommu group 19
[    7.211488] Freeing initrd memory: 14688K
[    7.212225] pci 0000:40:05.0: Adding to iommu group 20
[    7.221605] pci 0000:40:07.0: Adding to iommu group 21
[    7.226898] pci 0000:40:07.1: Adding to iommu group 21
[    7.232215] pci 0000:41:00.0: Adding to iommu group 22
[    7.237455] pci 0000:42:00.0: Adding to iommu group 21
[    7.242713] pci 0000:42:00.1: Adding to iommu group 21
[    7.250106] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[    7.257439] pci 0000:00:00.3: Adding to iommu group 23
[    7.262759] pci 0000:00:01.0: Adding to iommu group 24
[    7.268075] pci 0000:00:02.0: Adding to iommu group 25
[    7.273390] pci 0000:00:03.0: Adding to iommu group 26
[    7.278703] pci 0000:00:04.0: Adding to iommu group 27
[    7.284014] pci 0000:00:05.0: Adding to iommu group 28
[    7.289380] pci 0000:00:07.0: Adding to iommu group 29
[    7.294658] pci 0000:00:07.1: Adding to iommu group 29
[    7.300019] pci 0000:00:14.0: Adding to iommu group 30
[    7.305305] pci 0000:00:14.3: Adding to iommu group 30
[    7.310927] pci 0000:00:18.0: Adding to iommu group 31
[    7.316231] pci 0000:00:18.1: Adding to iommu group 31
[    7.321518] pci 0000:00:18.2: Adding to iommu group 31
[    7.326827] pci 0000:00:18.3: Adding to iommu group 31
[    7.332110] pci 0000:00:18.4: Adding to iommu group 31
[    7.337379] pci 0000:00:18.5: Adding to iommu group 31
[    7.342654] pci 0000:00:18.6: Adding to iommu group 31
[    7.347929] pci 0000:00:18.7: Adding to iommu group 31
[    7.353564] pci 0000:00:19.0: Adding to iommu group 32
[    7.358842] pci 0000:00:19.1: Adding to iommu group 32
[    7.364120] pci 0000:00:19.2: Adding to iommu group 32
[    7.369396] pci 0000:00:19.3: Adding to iommu group 32
[    7.374672] pci 0000:00:19.4: Adding to iommu group 32
[    7.379948] pci 0000:00:19.5: Adding to iommu group 32
[    7.385231] pci 0000:00:19.6: Adding to iommu group 32
[    7.390514] pci 0000:00:19.7: Adding to iommu group 32
[    7.395747] pci 0000:01:00.0: Adding to iommu group 29
[    7.400995] pci 0000:01:00.1: Adding to iommu group 29
[    7.406228] pci 0000:01:00.4: Adding to iommu group 29
[    7.411486] pci 0000:01:00.5: Adding to iommu group 29
[    7.419144] pci 0000:20:00.2: AMD-Vi: IOMMU performance counters supported
[    7.426444] pci 0000:20:00.3: Adding to iommu group 33
[    7.436734] pci 0000:20:01.0: Adding to iommu group 34
[    7.442049] pci 0000:20:02.0: Adding to iommu group 35
[    7.447363] pci 0000:20:03.0: Adding to iommu group 36
[    7.452682] pci 0000:20:04.0: Adding to iommu group 37
[    7.457997] pci 0000:20:05.0: Adding to iommu group 38
[    7.463361] pci 0000:20:07.0: Adding to iommu group 39
[    7.468646] pci 0000:20:07.1: Adding to iommu group 39
[    7.473869] pci 0000:21:00.0: Adding to iommu group 39
[    7.479100] pci 0000:21:00.1: Adding to iommu group 39
[    7.485883] pci 0000:e0:00.2: AMD-Vi: IOMMU performance counters supported
[    7.493172] pci 0000:e0:00.3: Adding to iommu group 40
[    7.498517] pci 0000:e0:01.0: Adding to iommu group 41
[    7.503838] pci 0000:e0:02.0: Adding to iommu group 42
[    7.509149] pci 0000:e0:03.0: Adding to iommu group 43
[    7.514461] pci 0000:e0:04.0: Adding to iommu group 44
[    7.519783] pci 0000:e0:05.0: Adding to iommu group 45
[    7.525142] pci 0000:e0:07.0: Adding to iommu group 46
[    7.530450] pci 0000:e0:07.1: Adding to iommu group 46
[    7.535677] pci 0000:e1:00.0: Adding to iommu group 46
[    7.540905] pci 0000:e1:00.1: Adding to iommu group 46
[    7.547750] pci 0000:c0:00.2: AMD-Vi: IOMMU performance counters supported
[    7.555007] pci 0000:c0:00.3: Adding to iommu group 47
[    7.560329] pci 0000:c0:01.0: Adding to iommu group 48
[    7.565669] pci 0000:c0:02.0: Adding to iommu group 49
[    7.570999] pci 0000:c0:03.0: Adding to iommu group 50
[    7.576336] pci 0000:c0:04.0: Adding to iommu group 51
[    7.581686] pci 0000:c0:05.0: Adding to iommu group 52
[    7.587054] pci 0000:c0:07.0: Adding to iommu group 53
[    7.592362] pci 0000:c0:07.1: Adding to iommu group 53
[    7.597589] pci 0000:c1:00.0: Adding to iommu group 53
[    7.602828] pci 0000:c1:00.1: Adding to iommu group 53
[    7.609776] pci 0000:80:00.2: AMD-Vi: IOMMU performance counters supported
[    7.617020] pci 0000:80:00.3: Adding to iommu group 54
[    7.622337] pci 0000:80:01.0: Adding to iommu group 55
[    7.627653] pci 0000:80:02.0: Adding to iommu group 56
[    7.632969] pci 0000:80:03.0: Adding to iommu group 57
[    7.638292] pci 0000:80:04.0: Adding to iommu group 58
[    7.643618] pci 0000:80:05.0: Adding to iommu group 59
[    7.648997] pci 0000:80:07.0: Adding to iommu group 60
[    7.654318] pci 0000:80:07.1: Adding to iommu group 60
[    7.659551] pci 0000:81:00.0: Adding to iommu group 60
[    7.664807] pci 0000:81:00.1: Adding to iommu group 60
[    7.670040] pci 0000:81:00.5: Adding to iommu group 60
[    7.676894] pci 0000:a0:00.2: AMD-Vi: IOMMU performance counters supported
[    7.684150] pci 0000:a0:00.3: Adding to iommu group 61
[    7.689470] pci 0000:a0:01.0: Adding to iommu group 62
[    7.694797] pci 0000:a0:02.0: Adding to iommu group 63
[    7.700110] pci 0000:a0:03.0: Adding to iommu group 64
[    7.705422] pci 0000:a0:04.0: Adding to iommu group 65
[    7.710736] pci 0000:a0:05.0: Adding to iommu group 66
[    7.716096] pci 0000:a0:07.0: Adding to iommu group 67
[    7.721406] pci 0000:a0:07.1: Adding to iommu group 67
[    7.726629] pci 0000:a1:00.0: Adding to iommu group 67
[    7.731862] pci 0000:a1:00.1: Adding to iommu group 67
[    7.738861] AMD-Vi: Extended features (0x25bf732fa2295afe, 0x1d): PPR X2APIC NX GT [5] IA GA PC GA_vAPIC
[    7.748467] AMD-Vi: Interrupt remapping enabled
[    7.753080] AMD-Vi: X2APIC enabled
[    7.758831] AMD-Vi: Virtual APIC enabled
[    7.762865] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    7.769389] software IO TLB: mapped [mem 0x00000000637cf000-0x00000000677cf000] (64MB)
[    7.778673] RAPL PMU: API unit is 2^-32 Joules, 1 fixed counters, 163840 ms ovfl timer
[    7.786695] RAPL PMU: hw unit of domain package 2^-16 Joules
[    7.792433] LVT offset 0 assigned for vector 0x400
[    7.798259] perf: AMD IBS detected (0x00000bff)
[    7.803895] amd_uncore: 16 amd_df counters detected
[    7.808902] amd_uncore: 6 amd_l3 counters detected
[    7.813799] amd_uncore: 4 amd_umc_0 counters detected
[    7.818970] amd_uncore: 4 amd_umc_1 counters detected
[    7.824131] amd_uncore: 4 amd_umc_2 counters detected
[    7.829309] amd_uncore: 4 amd_umc_3 counters detected
[    7.836053] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
[    7.843300] perf/amd_iommu: Detected AMD IOMMU #1 (2 banks, 4 counters/bank).
[    7.850530] perf/amd_iommu: Detected AMD IOMMU #2 (2 banks, 4 counters/bank).
[    7.857760] perf/amd_iommu: Detected AMD IOMMU #3 (2 banks, 4 counters/bank).
[    7.864983] perf/amd_iommu: Detected AMD IOMMU #4 (2 banks, 4 counters/bank).
[    7.872211] perf/amd_iommu: Detected AMD IOMMU #5 (2 banks, 4 counters/bank).
[    7.879442] perf/amd_iommu: Detected AMD IOMMU #6 (2 banks, 4 counters/bank).
[    7.886668] perf/amd_iommu: Detected AMD IOMMU #7 (2 banks, 4 counters/bank).
[    7.896091] workingset: timestamp_bits=40 max_order=26 bucket_order=0
[    7.902661] zbud: loaded
[    7.905442] SGI XFS with ACLs, security attributes, realtime, quota, no debug enabled
[    7.913906] xor: automatically using best checksumming function   avx       
[    7.921046] Key type asymmetric registered
[    7.925257] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)
[    7.932852] io scheduler mq-deadline registered
[    7.937468] io scheduler kyber registered
[    7.941572] io scheduler bfq registered
[    7.947984] pcieport 0000:00:00.3: PME: Signaling with IRQ 51
[    7.954090] pcieport 0000:00:07.1: PME: Signaling with IRQ 52
[    7.960312] pcieport 0000:20:00.3: PME: Signaling with IRQ 54
[    7.967351] pcieport 0000:20:07.1: PME: Signaling with IRQ 56
[    7.973544] pcieport 0000:40:00.3: PME: Signaling with IRQ 58
[    7.979583] pcieport 0000:40:01.1: PME: Signaling with IRQ 59
[    7.985871] pcieport 0000:40:07.1: PME: Signaling with IRQ 61
[    7.992066] pcieport 0000:60:00.3: PME: Signaling with IRQ 63
[    7.998194] pcieport 0000:60:01.1: PME: Signaling with IRQ 64
[    8.004294] pcieport 0000:60:05.2: PME: Signaling with IRQ 65
[    8.010377] pcieport 0000:60:05.3: PME: Signaling with IRQ 66
[    8.016418] pcieport 0000:60:07.1: PME: Signaling with IRQ 67
[    8.022569] pcieport 0000:60:07.2: PME: Signaling with IRQ 68
[    8.028991] pcieport 0000:80:00.3: PME: Signaling with IRQ 70
[    8.035210] pcieport 0000:80:07.1: PME: Signaling with IRQ 72
[    8.041829] pcieport 0000:a0:00.3: PME: Signaling with IRQ 74
[    8.047988] pcieport 0000:a0:07.1: PME: Signaling with IRQ 76
[    8.054204] pcieport 0000:c0:00.3: PME: Signaling with IRQ 78
[    8.061267] pcieport 0000:c0:07.1: PME: Signaling with IRQ 80
[    8.067478] pcieport 0000:e0:00.3: PME: Signaling with IRQ 82
[    8.073704] pcieport 0000:e0:07.1: PME: Signaling with IRQ 84
[    8.079933] IPMI message handler: version 39.2
[    8.084773] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    8.092383] ACPI: button: Power Button [PWRF]
[    8.100188] Monitor-Mwait will be used to enter C-1 state
[    8.109446] Could not retrieve perf counters (-19)
[    8.114780] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    8.121399] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    8.129039] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    8.137499] lp: driver loaded but no devices found
[    8.142674] Linux agpgart interface v0.103
[    8.149592] ACPI: bus type drm_connector registered
[    8.167510] brd: module loaded
[    8.176230] loop: module loaded
[    8.182797] drbd: initialized. Version: 8.4.11 (api:1/proto:86-101)
[    8.189150] drbd: built-in
[    8.191937] drbd: registered as block device major 147
[    8.197539] megaraid cmm: 2.20.2.7 (Release Date: Sun Jul 16 00:01:03 EST 2006)
[    8.205012] megaraid: 2.20.5.1 (Release Date: Thu Nov 16 15:32:35 EST 2006)
[    8.212094] megasas: 07.727.03.00-rc1
[    8.215884] mpt3sas version 48.100.00.00 loaded
[    8.221332] mpt3sas_cm0: 63 BIT PCI BUS DMA ADDRESSING SUPPORTED, total mem (263416596 kB)
[    8.285774] mpt3sas_cm0: MSI-X vectors supported: 128
[    8.290926] 	 no of cores: 64, max_msix_vectors: -1
[    8.295894] mpt3sas_cm0:  8 72 72
[    8.302668] mpt3sas_cm0: High IOPs queues : enabled
[    8.307632] mpt3sas0-msix0: PCI-MSI-X enabled: IRQ 86
[    8.312767] mpt3sas0-msix1: PCI-MSI-X enabled: IRQ 87
[    8.317918] mpt3sas0-msix2: PCI-MSI-X enabled: IRQ 88
[    8.323074] mpt3sas0-msix3: PCI-MSI-X enabled: IRQ 89
[    8.328221] mpt3sas0-msix4: PCI-MSI-X enabled: IRQ 90
[    8.333378] mpt3sas0-msix5: PCI-MSI-X enabled: IRQ 91
[    8.338525] mpt3sas0-msix6: PCI-MSI-X enabled: IRQ 92
[    8.343668] mpt3sas0-msix7: PCI-MSI-X enabled: IRQ 93
[    8.348809] mpt3sas0-msix8: PCI-MSI-X enabled: IRQ 94
[    8.353947] mpt3sas0-msix9: PCI-MSI-X enabled: IRQ 95
[    8.359083] mpt3sas0-msix10: PCI-MSI-X enabled: IRQ 96
[    8.364313] mpt3sas0-msix11: PCI-MSI-X enabled: IRQ 97
[    8.369539] mpt3sas0-msix12: PCI-MSI-X enabled: IRQ 98
[    8.374789] mpt3sas0-msix13: PCI-MSI-X enabled: IRQ 99
[    8.380144] mpt3sas0-msix14: PCI-MSI-X enabled: IRQ 100
[    8.385472] mpt3sas0-msix15: PCI-MSI-X enabled: IRQ 101
[    8.390778] mpt3sas0-msix16: PCI-MSI-X enabled: IRQ 102
[    8.396093] mpt3sas0-msix17: PCI-MSI-X enabled: IRQ 103
[    8.401407] mpt3sas0-msix18: PCI-MSI-X enabled: IRQ 104
[    8.406736] mpt3sas0-msix19: PCI-MSI-X enabled: IRQ 105
[    8.412059] mpt3sas0-msix20: PCI-MSI-X enabled: IRQ 106
[    8.417385] mpt3sas0-msix21: PCI-MSI-X enabled: IRQ 107
[    8.422701] mpt3sas0-msix22: PCI-MSI-X enabled: IRQ 108
[    8.428016] mpt3sas0-msix23: PCI-MSI-X enabled: IRQ 109
[    8.433322] mpt3sas0-msix24: PCI-MSI-X enabled: IRQ 110
[    8.438627] mpt3sas0-msix25: PCI-MSI-X enabled: IRQ 111
[    8.443933] mpt3sas0-msix26: PCI-MSI-X enabled: IRQ 112
[    8.449235] mpt3sas0-msix27: PCI-MSI-X enabled: IRQ 113
[    8.454552] mpt3sas0-msix28: PCI-MSI-X enabled: IRQ 114
[    8.459863] mpt3sas0-msix29: PCI-MSI-X enabled: IRQ 115
[    8.465166] mpt3sas0-msix30: PCI-MSI-X enabled: IRQ 116
[    8.470472] mpt3sas0-msix31: PCI-MSI-X enabled: IRQ 117
[    8.475779] mpt3sas0-msix32: PCI-MSI-X enabled: IRQ 118
[    8.481091] mpt3sas0-msix33: PCI-MSI-X enabled: IRQ 119
[    8.486405] mpt3sas0-msix34: PCI-MSI-X enabled: IRQ 120
[    8.491733] mpt3sas0-msix35: PCI-MSI-X enabled: IRQ 121
[    8.497052] mpt3sas0-msix36: PCI-MSI-X enabled: IRQ 122
[    8.502376] mpt3sas0-msix37: PCI-MSI-X enabled: IRQ 123
[    8.512723] mpt3sas0-msix38: PCI-MSI-X enabled: IRQ 124
[    8.518034] mpt3sas0-msix39: PCI-MSI-X enabled: IRQ 125
[    8.523339] mpt3sas0-msix40: PCI-MSI-X enabled: IRQ 126
[    8.528648] mpt3sas0-msix41: PCI-MSI-X enabled: IRQ 127
[    8.533965] mpt3sas0-msix42: PCI-MSI-X enabled: IRQ 128
[    8.539272] mpt3sas0-msix43: PCI-MSI-X enabled: IRQ 129
[    8.544583] mpt3sas0-msix44: PCI-MSI-X enabled: IRQ 130
[    8.549887] mpt3sas0-msix45: PCI-MSI-X enabled: IRQ 131
[    8.555191] mpt3sas0-msix46: PCI-MSI-X enabled: IRQ 132
[    8.560505] mpt3sas0-msix47: PCI-MSI-X enabled: IRQ 133
[    8.565820] mpt3sas0-msix48: PCI-MSI-X enabled: IRQ 134
[    8.571143] mpt3sas0-msix49: PCI-MSI-X enabled: IRQ 135
[    8.576455] mpt3sas0-msix50: PCI-MSI-X enabled: IRQ 136
[    8.581766] mpt3sas0-msix51: PCI-MSI-X enabled: IRQ 137
[    8.587096] mpt3sas0-msix52: PCI-MSI-X enabled: IRQ 138
[    8.592410] mpt3sas0-msix53: PCI-MSI-X enabled: IRQ 139
[    8.597723] mpt3sas0-msix54: PCI-MSI-X enabled: IRQ 140
[    8.603045] mpt3sas0-msix55: PCI-MSI-X enabled: IRQ 141
[    8.608363] mpt3sas0-msix56: PCI-MSI-X enabled: IRQ 142
[    8.613670] mpt3sas0-msix57: PCI-MSI-X enabled: IRQ 143
[    8.618979] mpt3sas0-msix58: PCI-MSI-X enabled: IRQ 144
[    8.624285] mpt3sas0-msix59: PCI-MSI-X enabled: IRQ 145
[    8.629590] mpt3sas0-msix60: PCI-MSI-X enabled: IRQ 146
[    8.634892] mpt3sas0-msix61: PCI-MSI-X enabled: IRQ 147
[    8.640197] mpt3sas0-msix62: PCI-MSI-X enabled: IRQ 148
[    8.645512] mpt3sas0-msix63: PCI-MSI-X enabled: IRQ 149
[    8.650826] mpt3sas0-msix64: PCI-MSI-X enabled: IRQ 150
[    8.656148] mpt3sas0-msix65: PCI-MSI-X enabled: IRQ 151
[    8.661465] mpt3sas0-msix66: PCI-MSI-X enabled: IRQ 152
[    8.666801] mpt3sas0-msix67: PCI-MSI-X enabled: IRQ 153
[    8.672114] mpt3sas0-msix68: PCI-MSI-X enabled: IRQ 154
[    8.677425] mpt3sas0-msix69: PCI-MSI-X enabled: IRQ 155
[    8.682735] mpt3sas0-msix70: PCI-MSI-X enabled: IRQ 156
[    8.688040] mpt3sas0-msix71: PCI-MSI-X enabled: IRQ 157
[    8.693346] mpt3sas_cm0: iomem(0x00000000d1000000), mapped(0x0000000041fc661c), size(1048576)
[    8.701969] mpt3sas_cm0: ioport(0x0000000000003000), size(256)
[    8.792764] mpt3sas_cm0: scatter gather: sge_in_main_msg(1), sge_per_chain(7), sge_per_io(128), chains_per_io(19)
[    8.804061] mpt3sas_cm0: request pool(0x0000000009c5f03d) - dma(0xff500000): depth(7200), frame_size(128), pool_size(900 kB)
[    8.834997] mpt3sas_cm0: sense pool(0x000000008f5d422a) - dma(0xfd700000): depth(7131), element_size(96), pool_size (668 kB)
[    8.846422] mpt3sas_cm0: reply pool(0x000000000712389c) - dma(0xfd600000): depth(7264), frame_size(128), pool_size(908 kB)
[    8.857606] mpt3sas_cm0: config page(0x00000000db0e4179) - dma(0xfd5f6000): size(512)
[    8.865532] mpt3sas_cm0: Allocated physical memory: size(40079 kB)
[    8.871799] mpt3sas_cm0: Current Controller Queue Depth(7128),Max Controller Queue Depth(7168)
[    8.880509] mpt3sas_cm0: Scatter Gather Elements per IO(128)
[    8.931842] mpt3sas_cm0: _base_display_fwpkg_version: complete
[    8.937781] mpt3sas_cm0: FW Package Ver(24.15.14.00)
[    8.943506] mpt3sas_cm0: SAS3816: FWVersion(24.15.05.00), ChipRevision(0x00)
[    8.950296] tsc: Refined TSC clocksource calibration: 4099.994 MHz
[    8.950646] NVMe
[    8.950749] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x3b1958df585, max_idle_ns: 440795223934 ns
[    8.956927] mpt3sas_cm0: Protocol=(Initiator,Target), Capabilities=(TLR,EEDP,Diag Trace Buffer,Task Set Full,NCQ)
[    8.979350] clocksource: Switched to clocksource tsc
[    8.979470] mpt3sas_cm0: Enable interrupt coalescing only for first	8 reply queues
[    8.992181] mpt3sas_cm0: performance mode: balanced
[    8.997217] mpt3sas 0000:41:00.0: Max SCSIIO MPT commands: 7128 shared with nr_hw_queues = 64
[    9.005871] scsi host0: Fusion MPT SAS Host
[    9.011672] mpt3sas_cm0: registering trace buffer support
[    9.012663] ahci 0000:66:00.0: version 3.0
[    9.017904] ahci 0000:66:00.0: AHCI vers 0001.0301, 32 command slots, 6 Gbps, SATA mode
[    9.021107] mpt3sas_cm0: Trace buffer memory 2048 KB allocated
[    9.026019] ahci 0000:66:00.0: 4/4 ports implemented (port mask 0xf)
[    9.026094] mpt3sas_cm0: sending port enable !!
[    9.026166] ahci 0000:66:00.0: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part sxs 
[    9.026536] mpt3sas_cm0: hba_port entry: 000000001bc2870f, port: 0 is added to hba_port list
[    9.033170] scsi host1: ahci
[    9.039436] mpt3sas_cm0: hba_port entry: 000000003fefb614, port: 8 is added to hba_port list
[    9.043778] scsi host2: ahci
[    9.052972] mpt3sas_cm0: hba_port entry: 00000000626400f2, port: 11 is added to hba_port list
[    9.061462] scsi host3: ahci
[    9.064122] mpt3sas_cm0: hba_port entry: 00000000a3a306d6, port: 10 is added to hba_port list
[    9.072918] scsi host4: ahci
[    9.075658] mpt3sas_cm0: hba_port entry: 00000000c405eae7, port: 9 is added to hba_port list
[    9.084238] ata1: SATA max UDMA/133 abar m2048@0xe7900000 port 0xe7900100 irq 159 lpm-pol 0
[    9.087372] mpt3sas_cm0: vphy entry: 0000000041725d45, port id: 0, phy:17 is added to port's vphys_list
[    9.095749] ata2: SATA max UDMA/133 abar m2048@0xe7900000 port 0xe7900180 irq 160 lpm-pol 0
[    9.096239] mpt3sas_cm0: host_add: handle(0x0001), sas_addr(0x5c0470e0d40cc200), phys(21)
[    9.098831] ata3: SATA max UDMA/133 abar m2048@0xe7900000 port 0xe7900200 irq 161 lpm-pol 0
[    9.098835] ata4: SATA max UDMA/133 abar m2048@0xe7900000 port 0xe7900280 irq 162 lpm-pol 0
[    9.099431] mpt3sas_cm0: handle(0x17) sas_address(0x3c0470e0d40cc20c) port_type(0x1)
[    9.108280] tun: Universal TUN/TAP device driver, 1.6
[    9.120998] scsi 0:0:0:0: Direct-Access     ATA      TOSHIBA MG09ACA1 GF07 PQ: 0 ANSI: 6
[    9.125533] Fusion MPT base driver 3.04.20
[    9.133856] scsi 0:0:0:0: SATA: handle(0x0017), sas_addr(0x3c0470e0d40cc20c), phy(12), device_name(0x5000039db8d2284b)
[    9.133926] Copyright (c) 1999-2008 LSI Corporation
[    9.133992] scsi 0:0:0:0: enclosure logical id (0x3c0470e0d4092108), slot(3) 
[    9.134088] Fusion MPT SPI Host driver 3.04.20
[    9.134149] scsi 0:0:0:0: enclosure level(0x0001), connector name( C0  )
[    9.134259] Fusion MPT FC Host driver 3.04.20
[    9.134337] scsi 0:0:0:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    9.134392] Fusion MPT SAS Host driver 3.04.20
[    9.134423] scsi 0:0:0:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[    9.134543] Fusion MPT misc device (ioctl) driver 3.04.20
[    9.188475]  end_device-0:0: add: handle(0x0017), sas_addr(0x3c0470e0d40cc20c)
[    9.195503] mptctl: Registered with Fusion MPT base driver
[    9.200476] mpt3sas_cm0: handle(0x1a) sas_address(0x58ce38ee234b7cde) port_type(0x1)
[    9.207599] mptctl: /dev/mptctl @ (major,minor=10,220)
[    9.208134] xhci_hcd 0000:01:00.4: xHCI Host Controller
[    9.213337] scsi 0:0:1:0: Direct-Access     KIOXIA   KPM7XRUG7T68     C10E PQ: 0 ANSI: 7
[    9.218971] xhci_hcd 0000:01:00.4: new USB bus registered, assigned bus number 1
[    9.219027] scsi 0:0:1:0: SSP: handle(0x001a), sas_addr(0x58ce38ee234b7cde), phy(13), device_name(0x58ce38ee234b7cdc)
[    9.219563] xhci_hcd 0000:01:00.4: hcc params 0x0118ffc5 hci version 0x120 quirks 0x0000000200000010
[    9.219950] scsi 0:0:1:0: enclosure logical id (0x3c0470e0d4092108), slot(2) 
[    9.219950] scsi 0:0:1:0: enclosure level(0x0001), connector name( C0  )
[    9.223597] scsi 0:0:1:0: qdepth(64), tagged(1), scsi_level(8), cmd_que(1)
[    9.224292] xhci_hcd 0000:01:00.4: xHCI Host Controller
[    9.235295]  end_device-0:1: add: handle(0x001a), sas_addr(0x58ce38ee234b7cde)
[    9.236757] xhci_hcd 0000:01:00.4: new USB bus registered, assigned bus number 2
[    9.236922] mpt3sas_cm0: handle(0x19) sas_address(0x3c0470e0d40cc20e) port_type(0x1)
[    9.243812] xhci_hcd 0000:01:00.4: Host supports USB 3.1 Enhanced SuperSpeed
[    9.245867] scsi 0:0:2:0: Direct-Access     ATA      HUS722T2TALA600  MU03 PQ: 0 ANSI: 6
[    9.249737] hub 1-0:1.0: USB hub found
[    9.256734] scsi 0:0:2:0: SATA: handle(0x0019), sas_addr(0x3c0470e0d40cc20e), phy(14), device_name(0x50014ee216939fe3)
[    9.256854] hub 1-0:1.0: 2 ports detected
[    9.256900] scsi 0:0:2:0: enclosure logical id (0x3c0470e0d4092108), slot(1) 
[    9.257909] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    9.257706] scsi 0:0:2:0: enclosure level(0x0001), connector name( C0  )
[    9.262606] scsi 0:0:2:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    9.262884] hub 2-0:1.0: USB hub found
[    9.270474] scsi 0:0:2:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[    9.291423]  end_device-0:2: add: handle(0x0019), sas_addr(0x3c0470e0d40cc20e)
[    9.296775] hub 2-0:1.0: 2 ports detected
[    9.296867] mpt3sas_cm0: handle(0x18) sas_address(0x3c0470e0d40cc20f) port_type(0x1)
[    9.308581] xhci_hcd 0000:65:00.4: xHCI Host Controller
[    9.318629] scsi 0:0:3:0: Direct-Access     ATA      HUS722T2TALA600  MU03 PQ: 0 ANSI: 6
[    9.323941] xhci_hcd 0000:65:00.4: new USB bus registered, assigned bus number 3
[    9.324020] scsi 0:0:3:0: SATA: handle(0x0018), sas_addr(0x3c0470e0d40cc20f), phy(15), device_name(0x50014ee216932c48)
[    9.324492] xhci_hcd 0000:65:00.4: hcc params 0x0118ffc5 hci version 0x120 quirks 0x0000000200000010
[    9.324923] scsi 0:0:3:0: enclosure logical id (0x3c0470e0d4092108), slot(0) 
[    9.324923] scsi 0:0:3:0: enclosure level(0x0001), connector name( C0  )
[    9.330952] scsi 0:0:3:0: atapi(n), ncq(y), asyn_notify(n), smart(y), fua(y), sw_preserve(y)
[    9.331558] xhci_hcd 0000:65:00.4: xHCI Host Controller
[    9.337980] scsi 0:0:3:0: qdepth(32), tagged(1), scsi_level(7), cmd_que(1)
[    9.359038]  end_device-0:3: add: handle(0x0018), sas_addr(0x3c0470e0d40cc20f)
[    9.365981] xhci_hcd 0000:65:00.4: new USB bus registered, assigned bus number 4
[    9.365992] xhci_hcd 0000:65:00.4: Host supports USB 3.1 Enhanced SuperSpeed
[    9.366341] mpt3sas_cm0: handle(0x12) sas_address(0x3c0570e0d40cc208) port_type(0x0)
[    9.373545] hub 3-0:1.0: USB hub found
[    9.378867] scsi 0:0:4:0: Enclosure         DP       BP_PSV           7.10 PQ: 0 ANSI: 7
[    9.386484] hub 3-0:1.0: 2 ports detected
[    9.386551] scsi 0:0:4:0: set ignore_delay_remove for handle(0x0012)
[    9.387511] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    9.387465] scsi 0:0:4:0: SES: handle(0x0012), sas_addr(0x3c0570e0d40cc208), phy(17), device_name(0x3c0570e0d40cc208)
[    9.387465] scsi 0:0:4:0: enclosure logical id (0x3c0470e0d4092108), slot(8) 
[    9.387465] scsi 0:0:4:0: enclosure level(0x0001), connector name( C0  )
[    9.390495] scsi 0:0:4:0: qdepth(1), tagged(0), scsi_level(8), cmd_que(0)
[    9.390765] hub 4-0:1.0: USB hub found
[    9.401700]  end_device-0:4: add: handle(0x0012), sas_addr(0x3c0570e0d40cc208)
[    9.405513] hub 4-0:1.0: 2 ports detected
[    9.413297] mpt3sas_cm0: port enable: SUCCESS
[    9.416140] ata1: SATA link down (SStatus 0 SControl 300)
[    9.416172] ata2: SATA link down (SStatus 0 SControl 300)
[    9.416205] ata4: SATA link down (SStatus 0 SControl 300)
[    9.420485] ata3: SATA link down (SStatus 0 SControl 300)
[    9.422417] usbcore: registered new interface driver usb-storage
[    9.428275] scsi 0:0:0:0: Attached scsi generic sg0 type 0
[    9.430790] sd 0:0:0:0: [sda] 23437770752 512-byte logical blocks: (12.0 TB/10.9 TiB)
[    9.430795] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    9.435229] sd 0:0:0:0: [sda] Write Protect is off
[    9.435233] sd 0:0:0:0: [sda] Mode Sense: 6b 00 10 08
[    9.436437] i8042: PNP: No PS/2 controller found.
[    9.439674] sd 0:0:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    9.440424] scsi 0:0:1:0: Attached scsi generic sg1 type 0
[    9.440688] sd 0:0:1:0: [sdb] 15002931888 512-byte logical blocks: (7.68 TB/6.99 TiB)
[    9.440691] sd 0:0:1:0: [sdb] 4096-byte physical blocks
[    9.440870] sd 0:0:1:0: [sdb] Write Protect is off
[    9.440873] sd 0:0:1:0: [sdb] Mode Sense: 87 00 10 08
[    9.441107] sd 0:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    9.447331] rtc_cmos 00:02: RTC can wake from S4
[    9.454719] scsi 0:0:2:0: Attached scsi generic sg2 type 0
[    9.455750] sd 0:0:2:0: [sdc] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    9.459018] rtc_cmos 00:02: registered as rtc0
[    9.463456] sd 0:0:2:0: [sdc] Write Protect is off
[    9.463460] sd 0:0:2:0: [sdc] Mode Sense: 6b 00 10 08
[    9.466006] sd 0:0:2:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    9.466612] scsi 0:0:3:0: Attached scsi generic sg3 type 0
[    9.467628] sd 0:0:3:0: [sdd] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    9.471766] rtc_cmos 00:02: setting system clock to 2025-01-27T11:47:56 UTC (1737978476)
[    9.471916] ses 0:0:4:0: Attached Enclosure device
[    9.475363] sd 0:0:3:0: [sdd] Write Protect is off
[    9.475367] sd 0:0:3:0: [sdd] Mode Sense: 6b 00 10 08
[    9.477935] sd 0:0:3:0: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    9.479986] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram
[    9.480088] ses 0:0:4:0: Attached scsi generic sg4 type 13
[    9.487804] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
[    9.491443] sd 0:0:1:0: [sdb] Attached SCSI disk
[    9.493621] sd 0:0:0:0: [sda] Attached SCSI disk
[    9.532293] usb 1-1: new high-speed USB device number 2 using xhci_hcd
[    9.535310] hid: raw HID events driver (C) Jiri Kosina
[    9.638267] usb 3-1: new high-speed USB device number 2 using xhci_hcd
[    9.645528] Key type dns_resolver registered
[    9.697751] hub 1-1:1.0: USB hub found
[    9.716936] sd 0:0:2:0: [sdc] Attached SCSI disk
[    9.719491] hub 1-1:1.0: 2 ports detected
[    9.733516] microcode: Current revision: 0x0a101148
[    9.821564] hub 3-1:1.0: USB hub found
[    9.899689] hub 3-1:1.0: 4 ports detected
[    9.903038] IPI shorthand broadcast: enabled
[    9.911905] sched_clock: Marking stable (8122003294, 1789240507)->(10433793286, -522549485)
[    9.920861] registered taskstats version 1
[    9.928692] Demotion targets for Node 0: null
[    9.933140] Demotion targets for Node 1: null
[   10.018558] usb 3-2: new full-speed USB device number 3 using xhci_hcd
[   10.199100]  sdd: sdd1 sdd2 sdd3 sdd4
[   10.203269] sd 0:0:3:0: [sdd] Attached SCSI disk
[   10.209600] Freeing unused kernel image (initmem) memory: 3136K
[   10.215622] Write protecting the kernel read-only data: 22528k
[   10.222059] Freeing unused kernel image (rodata/data gap) memory: 908K
[   10.228679] Run /init as init process
[   10.232424]   with arguments:
[   10.232428]     /init
[   10.232430]   with environment:
[   10.232433]     HOME=/
[   10.232435]     TERM=linux
[   10.530999] XFS (sdd1): Mounting V5 Filesystem d3a74a06-74e7-4c64-9944-81356db77603
[   10.589525] usb 3-1.1: new high-speed USB device number 4 using xhci_hcd
[   10.693370] XFS (sdd1): Ending clean mount
[   10.717550] hub 3-1.1:1.0: USB hub found
[   10.721800] hub 3-1.1:1.0: 4 ports detected
[   10.790307] usb 3-1.4: new high-speed USB device number 5 using xhci_hcd
[   10.909584] hub 3-1.4:1.0: USB hub found
[   10.913799] hub 3-1.4:1.0: 4 ports detected
[   11.362903] systemd[1]: Inserted module 'autofs4'
[   11.416699] NET: Registered PF_INET6 protocol family
[   11.422759] Segment Routing with IPv6
[   11.426531] In-situ OAM (IOAM) with IPv6
[   11.611487] systemd[1]: systemd 242 running in system mode. (+PAM -AUDIT -SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[   11.633131] systemd[1]: Detected architecture x86-64.
[   11.659830] systemd[1]: Set hostname to <lucy.molgen.mpg.de>.
[   13.044518] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   13.051397] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   13.059270] systemd[1]: Listening on Journal Socket.
[   13.077839] systemd[1]: Mounting Huge Pages File System...
[   13.084003] systemd[1]: Mounting Kernel Debug File System...
[   13.090321] systemd[1]: Mounting NFSD configuration filesystem...
[   13.096717] systemd[1]: Listening on Journal Socket (/dev/log).
[   13.268226] RPC: Registered named UNIX socket transport module.
[   13.274270] RPC: Registered udp transport module.
[   13.279074] RPC: Registered tcp transport module.
[   13.283882] RPC: Registered tcp-with-tls transport module.
[   13.289475] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   14.156283] systemd-journald[570]: Received request to flush runtime journal from PID 1
[   14.657287] ipmi_si: IPMI System Interface driver
[   14.662127] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS
[   14.668577] ipmi_platform: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10
[   14.676001] ipmi_si: Adding SMBIOS-specified kcs state machine
[   14.682023] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI
[   14.688116] ipmi_si IPI0001:00: ipmi_platform: [io  0x0ca8] regsize 1 spacing 4 irq 0
[   14.696492] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI
[   14.705316] ipmi_si: Adding ACPI-specified kcs state machine
[   14.711721] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 0
[   14.726193] wmi_bus wmi_bus-PNP0C14:00: [Firmware Bug]: WQBC data block query control method not found
[   14.817751] pstore: Using crash dump compression: deflate
[   14.822870] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20)
[   14.823349] pstore: Registered efi_pstore as persistent store backend
[   14.848281] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0
[   14.855794] piix4_smbus 0000:00:14.0: Using register 0x02 for SMBus port selection
[   14.867895] piix4_smbus 0000:00:14.0: Auxiliary SMBus Host Controller at 0xb20
[   14.876067] i2c i2c-2: Successfully instantiated SPD at 0x50
[   14.882319] i2c i2c-2: Successfully instantiated SPD at 0x51
[   14.888657] i2c i2c-2: Successfully instantiated SPD at 0x52
[   14.895023] i2c i2c-2: Successfully instantiated SPD at 0x53
[   14.901949] ipmi_si IPI0001:00: IPMI kcs interface initialized
[   14.942584] tg3 0000:63:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address c4:cb:e1:e8:e3:0e
[   14.953226] tg3 0000:63:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[   14.963173] tg3 0000:63:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[   14.971118] tg3 0000:63:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit]
[   14.998070] tg3 0000:63:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address c4:cb:e1:e8:e3:0f
[   15.008690] tg3 0000:63:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[   15.018606] tg3 0000:63:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[   15.026530] tg3 0000:63:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[   15.204490] mgag200 0000:62:00.0: vgaarb: deactivate vga console
[   15.214455] Console: switching to colour dummy device 80x25
[   15.226095] [drm] Initialized mgag200 1.0.0 for 0000:62:00.0 on minor 0
[   15.233446] tpm_tis MSFT0101:00: 2.0 TPM (device-id 0xFC, rev-id 1)
[   15.239761] fbcon: mgag200drmfb (fb0) is primary device
[   15.261925] Adding 33554428k swap on /dev/sdd4.  Priority:-2 extents:1 across:33554428k 
[   15.306041] Console: switching to colour frame buffer device 128x48
[   15.376138] mgag200 0000:62:00.0: [drm] fb0: mgag200drmfb frame buffer device
[   15.387151] ice: Intel(R) Ethernet Connection E800 Series Linux Driver
[   15.393747] ice: Copyright (c) 2018, Intel Corporation.
[   15.401811] kvm_amd: TSC scaling supported
[   15.405462] usbcore: registered new interface driver usbhid
[   15.405957] kvm_amd: Nested Virtualization enabled
[   15.405988] usbhid: USB HID core driver
[   15.406006] kvm_amd: Nested Paging enabled
[   15.406008] kvm_amd: LBR virtualization supported
[   15.429167] kvm_amd: Virtual VMLOAD VMSAVE supported
[   15.434295] kvm_amd: Virtual GIF supported
[   15.438435] kvm_amd: Virtual NMI enabled
[   15.443586] input: Peppercon AG Multidevice as /devices/pci0000:60/0000:60:07.1/0000:65:00.4/usb3/3-2/3-2:1.0/0003:14DD:0002.0001/input/input1
[   15.508362] hid-generic 0003:14DD:0002.0001: input,hidraw0: USB HID v1.01 Keyboard [Peppercon AG Multidevice] on usb-0000:65:00.4-2/input0
[   15.521848] input: Peppercon AG Multidevice as /devices/pci0000:60/0000:60:07.1/0000:65:00.4/usb3/3-2/3-2:1.1/0003:14DD:0002.0002/input/input2
[   15.535801] hid-generic 0003:14DD:0002.0002: input,hidraw1: USB HID v1.01 Mouse [Peppercon AG Multidevice] on usb-0000:65:00.4-2/input1
[   15.938213] ice 0000:64:00.0: The DDP package was successfully loaded: ICE OS Default Package version 1.3.30.0
[   16.002318] ice 0000:64:00.0: 126.024 Gb/s available PCIe bandwidth (16.0 GT/s PCIe x8 link)
[   16.044946] ice 0000:64:00.0: PTP init successful
[   16.373684] ice 0000:64:00.1: DDP package already present on device: ICE OS Default Package version 1.3.30.0
[   16.494252] ice 0000:64:00.1: 126.024 Gb/s available PCIe bandwidth (16.0 GT/s PCIe x8 link)
[   16.536377] ice 0000:64:00.1: PTP init successful
[   17.449026] XFS (sdd2): Mounting V5 Filesystem 51b82156-03df-4991-8956-588f1145a4f9
[   17.611343] XFS (sdd2): Ending clean mount
[   17.640711] XFS (sdb): Mounting V5 Filesystem 648caa91-55c9-448f-9def-50331fa318c2
[   17.668786] XFS (sdb): Ending clean mount
[   17.699971] XFS (sda): Mounting V5 Filesystem 0f0e969b-4c1d-4af4-a042-3a5f628c76df
[   17.746592] XFS (sda): Ending clean mount
[   18.279915] tg3 0000:63:00.0 net00: renamed from eth0
[   18.300553] tg3 0000:63:00.1 net01: renamed from eth1
[   18.309869] ice 0000:64:00.0 net02: renamed from eth2
[   18.319624] ice 0000:64:00.1 net03: renamed from eth3
[   18.538539] ice 0000:64:00.1 net03: NIC Link is up 10 Gbps Full Duplex, Requested FEC: NONE, Negotiated FEC: NONE, Autoneg Advertised: On, Autoneg Negotiated: False, Flow Control: None
[   18.640482] 8021q: 802.1Q VLAN Support v1.8
[   18.645318] 8021q: adding VLAN 0 to HW filter on device net03
[   21.573099] NFSD: Using nfsdcld client tracking operations.
[   21.579398] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000000)
[   25.341798] netfs: FS-Cache loaded
[   25.531746] NFS: Registering the id_resolver key type
[   25.537156] Key type id_resolver registered
[   25.541412] Key type id_legacy registered
[  109.459711] usb 3-2: USB disconnect, device number 3

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Warning `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
  2025-01-27 12:41 Warning `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F) Paul Menzel
@ 2025-01-27 15:43 ` Mario Limonciello
       [not found]   ` <DS7PR12MB82528A694056F1FBA20CE01E96EF2@DS7PR12MB8252.namprd12.prod.outlook.com>
  0 siblings, 1 reply; 8+ messages in thread
From: Mario Limonciello @ 2025-01-27 15:43 UTC (permalink / raw)
  To: Paul Menzel, Huang Rui, Gautham R. Shenoy; +Cc: linux-pm

On 1/27/2025 06:41, Paul Menzel wrote:
> Dear Linux folks,
> 
> 
> On a Dell PowerEdge R7625 with two 32x AMD EPYC 9174F Linux 6.12 logs
> 
>      $ dmesg | grep -e "DMI:" -e "Linux version" -e microcode
>      [    0.000000] Linux version 6.12.11.mx64.479 
> (root@lucy.molgen.mpg.de) (gcc (GCC) 12.3.0, GNU ld (GNU Binutils) 2.41) 
> #1 SMP PREEMPT_DYNAMIC Fri Jan 24 13:30:47 CET 2025
>      [    0.000000] DMI: Dell Inc. PowerEdge R7625/0M7YXP, BIOS 1.10.6 
> 12/06/2024
>      [    0.000000] DMI: Memory slots populated: 4/24
>      [    9.487804] amd_pstate: the _CPC object is not present in SBIOS 
> or ACPI disabled
>      [    9.733516] microcode: Current revision: 0x0a101148
> 
> ACPI is enabled. What can I do about the warning?

You can look if the BIOS has any options for enabling it.  They might be 
called "CPPC".


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Warning `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
       [not found]   ` <DS7PR12MB82528A694056F1FBA20CE01E96EF2@DS7PR12MB8252.namprd12.prod.outlook.com>
@ 2025-01-28 10:49     ` Paul Menzel
  2025-01-28 15:08       ` Warnings `Could not retrieve perf counters (-19)` and " Paul Menzel
  0 siblings, 1 reply; 8+ messages in thread
From: Paul Menzel @ 2025-01-28 10:49 UTC (permalink / raw)
  To: Gautham Ranjal Shenoy, Mario Limonciello, Ray Huang; +Cc: linux-pm

[-- Attachment #1: Type: text/plain, Size: 1234 bytes --]

Dear Gautham, dear Mario,


Thank you for your quick replies. Gautham, messages with HTML are 
rejected by Linux kernel lists.


Am 28.01.25 um 04:51 schrieb Shenoy, Gautham Ranjal:

> As Mario mentioned, you need to enable the CPPC option. Looking for some of the Dell PowerEdge documation, there is an option called "Collaborative CPU Performance Control" (https://www.dell.com/support/manuals/en-in/poweredge-r730/r730_ompublication/system-profile-settings-details?guid=guid-2e9b46a1-71e3-4072-9d86-db648757f0e6&lang=en-us).
> 
> [cid:fe57df8f-3d99-4ea0-8f6e-b0daae49bb0e]
> Can you please try enabling it ?

You quoted the Dell PowerEdge R730. I couldn’t find it in the *Dell 
PowerEdge R7625 Installation and Service Manual* [1], and also it’s not 
listed in the iDRAC9 Web site (attached with added `.txt` extension to 
trick the Linux list).


Kind regards,

Paul


PS:

> --
> 
> Thanks and Regards
> 
> Gautham.

Only if you care: Your signature delimiter misses a space at the end [2].


[1]: 
https://www.dell.com/support/manuals/de-de/poweredge-r7625/per7625_ism_pub/system-profile-settings?guid=guid-9f6b6652-4079-45e7-90f5-1c8feee08ec0&lang=en-us
[2]: https://en.wikipedia.org/wiki/Signature_block#Standard_delimiter

[-- Attachment #2: 20250128--dell-poweredge-r7625--idrac9--bios--system-profile-settings.html.txt --]
[-- Type: text/plain, Size: 71769 bytes --]


    	<table-bios-inputs privileges="privileges" menu="menu" registry="AttributeRegistry" current-data="currentBIOSdata" backup-data="currentBIOSdata_bkp" pending-data="pendingBIOSdata" class="ng-isolate-scope"><div ng-hide="menu.Hidden" style="margin-left: 20px">
    <div class="header-label">
        <span class="header-expndr" ng-click="onExpanderToggle()">
            <i class="ci ci-icon ci-expndr-chev-dwn-med-core" ng-class="{'ci-expndr-chev-dwn-med-core' : !menu._collapsed, 'ci-link-core' : menu._collapsed}"></i>
        </span>
        <span ng-click="onExpanderToggle()">
            <label id="SysProfileSettingsRef" tabindex="0" ng-bind="menu.DisplayName" style="cursor:pointer;" ng-keydown="($event.which ===13)? onExpanderToggle(): ''" class="ng-binding">System Profile Settings</label>
        </span>
        <span style="float:right;" ng-show="!menu._collapsed" class="">
            <a ng-click="onHelpAction()"><i class="ci ci-color-blue ci-nav-help-core"></i></a>
        </span>
    </div>
    <form name="SysProfileSettingsRef" novalidate="" class="ng-pristine ng-valid">
        <!-- ngIf: !menu._collapsed --><div ng-if="!menu._collapsed" style="background-color: #F4F4F4; padding-bottom:20px;padding-left:20px" ng-init="onInit()" class="ng-scope">
            <table class="table" style="margin-bottom: 0;">
                <!-- ngIf: hideHeader --><thead ng-if="hideHeader" class="ng-scope"><tr><th style="width: 30%"></th><th translate="current_value" class="ng-scope">Current Value</th><th style="width: 30%" translate="pending_value" class="ng-scope">Pending Value</th></tr></thead><!-- end ngIf: hideHeader -->
                <tbody>
                    <!-- ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding"></label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer --><td ng-switch-when="Integer" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.BoostFMaxManual" ng-if="attribute.ReadOnly" ng-bind="currentData[attribute.AttributeName]" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' --><label ng-if="attribute.Type!='Enumeration'" ng-bind="pendingData[attribute.AttributeName]" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">System Profile</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly --><select id="SysProfileSettingsRef.SysProfile" ng-model="currentData[attribute.AttributeName]" ng-change="onBlur(attribute)" ng-if="!attribute.ReadOnly" ng-disabled="!privileges[menu._privilege] || menu._disabled" ng-options="option.ValueName as option.ValueDisplayName for option in attribute.Value" class="ng-pristine ng-valid ng-scope ng-not-empty ng-touched"><option label="Performance Per Watt (OS)" value="string:PerfPerWattOptimizedOs" selected="selected">Performance Per Watt (OS)</option><option label="Performance" value="string:PerfOptimized">Performance</option><option label="Custom" value="string:Custom">Custom</option></select><!-- end ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">CPU Power Management</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.ProcPwrPerf" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">OS DBPM</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Memory Frequency</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.MemFrequency" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Maximum Performance</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Turbo Boost</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.ProcTurboMode" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Enabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">C-States</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.ProcCStates" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Enabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Memory Patrol Scrub</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.MemPatrolScrub" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Standard</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Memory Refresh Rate</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.MemRefreshRate" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">1x</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Workload Profile</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly --><select id="SysProfileSettingsRef.WorkloadProfile" ng-model="currentData[attribute.AttributeName]" ng-change="onBlur(attribute)" ng-if="!attribute.ReadOnly" ng-disabled="!privileges[menu._privilege] || menu._disabled" ng-options="option.ValueName as option.ValueDisplayName for option in attribute.Value" class="ng-pristine ng-valid ng-scope ng-not-empty ng-touched"><option label="Not Configured" value="string:NotConfigured" selected="selected">Not Configured</option><option label="HPC Profile" value="string:HpcProfile">HPC Profile</option></select><!-- end ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Workload Profile Helper</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly --><select id="SysProfileSettingsRef.WorkloadProfileHelper" ng-model="currentData[attribute.AttributeName]" ng-change="onBlur(attribute)" ng-if="!attribute.ReadOnly" ng-disabled="!privileges[menu._privilege] || menu._disabled" ng-options="option.ValueName as option.ValueDisplayName for option in attribute.Value" class="ng-pristine ng-untouched ng-valid ng-scope ng-empty"><option value="?" selected="selected"></option><option label="Not Configured" value="string:NotConfigured">Not Configured</option><option label="HPC Profile" value="string:HpcProfile">HPC Profile</option><option label="Low Latency Optimized Profile" value="string:LowLatencyOptimizedProfile">Low Latency Optimized Profile</option><option label="Virtualization Optimized Performance Profile" value="string:VtOptimizedProfile">Virtualization Optimized Performance Profile</option><option label="Virtualization Optimized Performance Per Watt Profile" value="string:VtPerWattOptimizedProfile">Virtualization Optimized Performance Per Watt Profile</option><option label="DataBase Optimized Performance Profile" value="string:DbOptimizedProfile">DataBase Optimized Performance Profile</option><option label="Database Optimized Performance Per Watt Profile" value="string:DbPerWattOptimizedProfile">Database Optimized Performance Per Watt Profile</option><option label="SDS Optimized Performance Profile" value="string:SdsOptimizedProfile">SDS Optimized Performance Profile</option><option label="SDS Optimized Performance Per Watt Profile" value="string:SdsPerWattOptimizedProfile">SDS Optimized Performance Per Watt Profile</option><option label="Telco Optimized Profile" value="string:TelcoOptimizedProfile">Telco Optimized Profile</option><option label="NFVI FP Optimized Turbo Profile" value="string:NfviFpOptimizedTurboProfile">NFVI FP Optimized Turbo Profile</option><option label="NFVI FP Energy-Balance Turbo Profile" value="string:NfviFpEngBalTurboProfile">NFVI FP Energy-Balance Turbo Profile</option></select><!-- end ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">PCI ASPM L1 Link Power Management</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.PcieAspmL1" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Enabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">OS ACPI Cx</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.OsAcpiCx" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">OS Cx C2</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Pch Pcie Global Aspm</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.PchPcieAspm" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Periodic Directory Rinse (PDR) Tuning</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.PeriodicDirectoryRinseTuning" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Auto</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">CPPC</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly --><select id="SysProfileSettingsRef.Cppc" ng-model="currentData[attribute.AttributeName]" ng-change="onBlur(attribute)" ng-if="!attribute.ReadOnly" ng-disabled="!privileges[menu._privilege] || menu._disabled" ng-options="option.ValueName as option.ValueDisplayName for option in attribute.Value" class="ng-pristine ng-untouched ng-valid ng-scope ng-not-empty"><option label="Disabled" value="string:Disabled" selected="selected">Disabled</option><option label="Enabled" value="string:Enabled">Enabled</option></select><!-- end ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Determinism Control</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.DeterminismControl" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Manual Determinism Control</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Determinism Slider</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.DeterminismSlider" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Performance Determinism</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Power Profile Select</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.PowerProfileSelect" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">High Performance Mode</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">PCIE Speed PMM Control</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.PcieSpeedPmmControl" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Auto</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">EQ Bypass To Highest Rate</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.EqBypassToHighestRate" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Disabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">DF PState Frequency Optimizer</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.DfPstateFreqOptimizer" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Enabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">DF PState Latency Optimizer</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.DfPstateLatencyOptimizer" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Enabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">DF CState</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.DfCState" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Enabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Host System Management Port (HSMP) Support</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.Hsmp" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Enabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Boost FMax</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.BoostFMax" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">0 - Auto</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Algorithm Performance Boost Disable (ApbDis)</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.ApbDis" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Disabled</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">ApbDis Fixed Socket P-State</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.FixedSocPstate" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">P0</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">Dynamic Link Width Management (DLWM)</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.DynamicLinkWidthManagement" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">Unforced</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes --><tr ng-repeat="attribute in menu.Attributes" ng-hide="attribute.Hidden" ng-switch="" on="attribute.Type" class="ng-scope ng-hide">
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'Password'" class="ng-scope">
                            <label ng-bind="attribute.DisplayName" class="ng-binding">DLWM Forced Width</label>
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'Password' -->
                        <!-- ngIf: attribute.Type === 'Password' -->
                        <!-- ngSwitchWhen: String -->
                        <!-- ngSwitchWhen: Integer -->
                        <!-- ngSwitchWhen: Password -->
                        <!-- ngSwitchWhen: Enumeration --><td ng-switch-when="Enumeration" class="ng-scope">
                            <!-- ngIf: attribute.ReadOnly --><label id="SysProfileSettingsRef.DlwmForcedWidth" ng-if="attribute.ReadOnly" ng-bind="getCurrentValueDisplayName(attribute)" class="ng-binding ng-scope">x16</label><!-- end ngIf: attribute.ReadOnly -->
                            <!-- ngIf: !attribute.ReadOnly -->
                        </td><!-- end ngSwitchWhen: -->
                        <!-- ngSwitchWhen: OrderedList -->
                        <!-- ngSwitchWhen: SubMenu -->
                        <!-- ngSwitchDefault: -->
                        <!-- ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' --><td style="width: 30%" ng-if="attribute.Type !== 'SubMenu' &amp;&amp; attribute.Type !== 'OrderedList'" class="ng-scope">
                            <!-- ngIf: attribute.Type=='Enumeration' --><label ng-if="attribute.Type=='Enumeration'" ng-bind="getPendingValueDisplayName(attribute)" class="ng-binding ng-scope"></label><!-- end ngIf: attribute.Type=='Enumeration' -->
                            <!-- ngIf: attribute.Type!='Enumeration' -->
                        </td><!-- end ngIf: attribute.Type !== 'SubMenu' && attribute.Type !== 'OrderedList' -->
                        <!-- ngIf: attribute.Type === 'OrderedList' -->
                    </tr><!-- end ngRepeat: attribute in menu.Attributes -->
                </tbody>
                <!-- ngIf: menu._editable --><tfoot ng-if="menu._editable" class="ng-scope">
                    <tr>
                        <td style="width: 30%"></td>
                        <td>
                            <span class="btn-group">
                                <button ng-click="onApplyAction()" ng-disabled="!privileges[menu._privilege] || SysProfileSettingsRef.$invalid || SysProfileSettingsRef.$pristine || menu._disabled" class="btn btn-primary ng-scope" style="margin-right: 10px" translate="apply" disabled="disabled">Apply</button>
                                <button ng-click="onDiscardAction()" ng-disabled="!privileges[menu._privilege] || SysProfileSettingsRef.$pristine || menu._disabled" class="btn btn-default ng-scope" translate="discard" disabled="disabled">Discard</button>
                            </span>
                        </td>
                    </tr>
                </tfoot><!-- end ngIf: menu._editable -->
            </table>
        </div><!-- end ngIf: !menu._collapsed -->
    </form>
</div>
</table-bios-inputs>

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Warnings `Could not retrieve perf counters (-19)` and `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
  2025-01-28 10:49     ` Paul Menzel
@ 2025-01-28 15:08       ` Paul Menzel
  2025-02-11 16:12         ` Paul Menzel
  0 siblings, 1 reply; 8+ messages in thread
From: Paul Menzel @ 2025-01-28 15:08 UTC (permalink / raw)
  To: Gautham Ranjal Shenoy, Mario Limonciello, Ray Huang,
	Thomas Gleixner, Ingo Molnar, Borislav Petkov, Dave Hansen, x86
  Cc: linux-pm, linux-acpi, LKML

[Cc: +x86 maintainers and ACPI list]

Dear Linux folks,


Am 28.01.25 um 11:49 schrieb Paul Menzel:

> Thank you for your quick replies. Gautham, messages with HTML are 
> rejected by Linux kernel lists.
> 
> 
> Am 28.01.25 um 04:51 schrieb Shenoy, Gautham Ranjal:
> 
>> As Mario mentioned, you need to enable the CPPC option. Looking for 
>> some of the Dell PowerEdge documentation, there is an option called 
>> "Collaborative CPU Performance Control" (https://www.dell.com/support/manuals/en-in/poweredge-r730/r730_ompublication/system-profile-settings-details?guid=guid-2e9b46a1-71e3-4072-9d86-db648757f0e6&lang=en-us).
>>
>> [cid:fe57df8f-3d99-4ea0-8f6e-b0daae49bb0e]
>> Can you please try enabling it ?
> 
> You quoted the Dell PowerEdge R730. I couldn’t find it in the *Dell 
> PowerEdge R7625 Installation and Service Manual* [1], and also it’s not 
> listed in the iDRAC9 Web site (attached with added `.txt` extension to 
> trick the Linux list).

The amd_pstate warning seems to be related to the perf counters warning 
Linux prints earlier:

     $ dmesg --level alert,crit,err,warn
     [    2.666393] Spectre V2 : WARNING: Unprivileged eBPF is enabled 
with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
     [    8.109446] Could not retrieve perf counters (-19)
     [    9.386551] scsi 0:0:4:0: set ignore_delay_remove for handle(0x0012)
     [    9.487804] amd_pstate: the _CPC object is not present in SBIOS 
or ACPI disabled
     [   14.726193] wmi_bus wmi_bus-PNP0C14:00: [Firmware Bug]: WQBC 
data block query control method not found

x86 maintainers, the original report with the Linux logs attached is in 
the archive [3].

It looks like, there is something missing in the Dell firmware to enable 
the feature.

The perf counters warning is from `amd_set_max_freq_ratio()` in 
`arch/x86/kernel/acpi/cppc.c`:

```
static void amd_set_max_freq_ratio(void)
{
         struct cppc_perf_caps perf_caps;
         u64 numerator, nominal_perf;
         u64 perf_ratio;
         int rc;

         rc = cppc_get_perf_caps(0, &perf_caps);
         if (rc) {
                 pr_warn("Could not retrieve perf counters (%d)\n", rc);
                 return;
         }
         […]
}
```

With

     include/uapi/asm-generic/errno-base.h:#define	ENODEV		19	/* No such 
device */

this is returned by in `drivers/acpi/cppc_acpi.c`:

```
/**
  * cppc_get_perf_caps - Get a CPU's performance capabilities.
  * @cpunum: CPU from which to get capabilities info.
  * @perf_caps: ptr to cppc_perf_caps. See cppc_acpi.h
  *
  * Return: 0 for success with perf_caps populated else -ERRNO.
  */
int cppc_get_perf_caps(int cpunum, struct cppc_perf_caps *perf_caps)
{
         struct cpc_desc *cpc_desc = per_cpu(cpc_desc_ptr, cpunum);
         […]
         if (!cpc_desc) {
                 pr_debug("No CPC descriptor for CPU:%d\n", cpunum);
                 return -ENODEV;
         }
         […]
}
```

Just for your information.


Kind regards,

Paul


> PS:
> 
>> -- 
>>
>> Thanks and Regards
>>
>> Gautham.
> 
> Only if you care: Your signature delimiter misses a space at the end [2].
> 
> 
> [1]: https://www.dell.com/support/manuals/de-de/poweredge-r7625/per7625_ism_pub/system-profile-settings?guid=guid-9f6b6652-4079-45e7-90f5-1c8feee08ec0&lang=en-us
> [2]: https://en.wikipedia.org/wiki/Signature_block#Standard_delimiter
[3]: 
https://lore.kernel.org/linux-pm/d09f52d8-e084-4875-9608-5b3db2554f3d@molgen.mpg.de/T/#t

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Warnings `Could not retrieve perf counters (-19)` and `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
  2025-01-28 15:08       ` Warnings `Could not retrieve perf counters (-19)` and " Paul Menzel
@ 2025-02-11 16:12         ` Paul Menzel
  2025-02-11 16:18           ` Mario Limonciello
  0 siblings, 1 reply; 8+ messages in thread
From: Paul Menzel @ 2025-02-11 16:12 UTC (permalink / raw)
  To: Gautham Ranjal Shenoy, Mario Limonciello, Ray Huang,
	Thomas Gleixner, Ingo Molnar, Borislav Petkov, Dave Hansen, x86
  Cc: linux-pm, linux-acpi, LKML

Dear Linux folks,


Am 28.01.25 um 16:08 schrieb Paul Menzel:
> [Cc: +x86 maintainers and ACPI list]

> Am 28.01.25 um 11:49 schrieb Paul Menzel:
> 
>> Thank you for your quick replies. Gautham, messages with HTML are 
>> rejected by Linux kernel lists.
>>
>>
>> Am 28.01.25 um 04:51 schrieb Shenoy, Gautham Ranjal:
>>
>>> As Mario mentioned, you need to enable the CPPC option. Looking for 
>>> some of the Dell PowerEdge documentation, there is an option called 
>>> "Collaborative CPU Performance Control" (https://www.dell.com/ 
>>> support/manuals/en-in/poweredge-r730/r730_ompublication/system- 
>>> profile-settings-details?guid=guid-2e9b46a1-71e3-4072-9d86- 
>>> db648757f0e6&lang=en-us).
>>>
>>> [cid:fe57df8f-3d99-4ea0-8f6e-b0daae49bb0e]
>>> Can you please try enabling it ?
>>
>> You quoted the Dell PowerEdge R730. I couldn’t find it in the *Dell 
>> PowerEdge R7625 Installation and Service Manual* [1], and also it’s 
>> not listed in the iDRAC9 Web site (attached with added `.txt` 
>> extension to trick the Linux list).
> 
> The amd_pstate warning seems to be related to the perf counters warning 
> Linux prints earlier:
> 
>      $ dmesg --level alert,crit,err,warn
>      [    2.666393] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
>      [    8.109446] Could not retrieve perf counters (-19)
>      [    9.386551] scsi 0:0:4:0: set ignore_delay_remove for handle(0x0012)
>      [    9.487804] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
>      [   14.726193] wmi_bus wmi_bus-PNP0C14:00: [Firmware Bug]: WQBC data block query control method not found
> 
> x86 maintainers, the original report with the Linux logs attached is in 
> the archive [3].
> 
> It looks like, there is something missing in the Dell firmware to enable 
> the feature.
> 
> The perf counters warning is from `amd_set_max_freq_ratio()` in `arch/ 
> x86/kernel/acpi/cppc.c`:
> 
> ```
> static void amd_set_max_freq_ratio(void)
> {
>          struct cppc_perf_caps perf_caps;
>          u64 numerator, nominal_perf;
>          u64 perf_ratio;
>          int rc;
> 
>          rc = cppc_get_perf_caps(0, &perf_caps);
>          if (rc) {
>                  pr_warn("Could not retrieve perf counters (%d)\n", rc);
>                  return;
>          }
>          […]
> }
> ```
> 
> With
> 
>      include/uapi/asm-generic/errno-base.h:#define    ENODEV        19    /* No such device */
> 
> this is returned by in `drivers/acpi/cppc_acpi.c`:
> 
> ```
> /**
>   * cppc_get_perf_caps - Get a CPU's performance capabilities.
>   * @cpunum: CPU from which to get capabilities info.
>   * @perf_caps: ptr to cppc_perf_caps. See cppc_acpi.h
>   *
>   * Return: 0 for success with perf_caps populated else -ERRNO.
>   */
> int cppc_get_perf_caps(int cpunum, struct cppc_perf_caps *perf_caps)
> {
>          struct cpc_desc *cpc_desc = per_cpu(cpc_desc_ptr, cpunum);
>          […]
>          if (!cpc_desc) {
>                  pr_debug("No CPC descriptor for CPU:%d\n", cpunum);
>                  return -ENODEV;
>          }
>          […]
> }
> ```

@AMD folks, just for clarity. Did Dell something with their firmware? If 
so, are you going to work with Dell on a solution, or do I need to 
report the issue to them?


Kind regards,

Paul


>> PS:
>>
>>> -- 
>>>
>>> Thanks and Regards
>>>
>>> Gautham.
>>
>> Only if you care: Your signature delimiter misses a space at the end [2].
>>
>>
>> [1]: https://www.dell.com/support/manuals/de-de/poweredge-r7625/per7625_ism_pub/system-profile-settings?guid=guid-9f6b6652-4079-45e7-90f5-1c8feee08ec0&lang=en-us
>> [2]: https://en.wikipedia.org/wiki/Signature_block#Standard_delimiter
> [3]: https://lore.kernel.org/linux-pm/d09f52d8-e084-4875-9608-5b3db2554f3d@molgen.mpg.de/T/#t

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Warnings `Could not retrieve perf counters (-19)` and `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
  2025-02-11 16:12         ` Paul Menzel
@ 2025-02-11 16:18           ` Mario Limonciello
  2025-03-10 15:17             ` Paul Menzel
  0 siblings, 1 reply; 8+ messages in thread
From: Mario Limonciello @ 2025-02-11 16:18 UTC (permalink / raw)
  To: Paul Menzel, Gautham Ranjal Shenoy, Ray Huang, Thomas Gleixner,
	Ingo Molnar, Borislav Petkov, Dave Hansen, x86
  Cc: linux-pm, linux-acpi, LKML

On 2/11/2025 10:12, Paul Menzel wrote:
> Dear Linux folks,
> 
> 
> Am 28.01.25 um 16:08 schrieb Paul Menzel:
>> [Cc: +x86 maintainers and ACPI list]
> 
>> Am 28.01.25 um 11:49 schrieb Paul Menzel:
>>
>>> Thank you for your quick replies. Gautham, messages with HTML are 
>>> rejected by Linux kernel lists.
>>>
>>>
>>> Am 28.01.25 um 04:51 schrieb Shenoy, Gautham Ranjal:
>>>
>>>> As Mario mentioned, you need to enable the CPPC option. Looking for 
>>>> some of the Dell PowerEdge documentation, there is an option called 
>>>> "Collaborative CPU Performance Control" (https://www.dell.com/ 
>>>> support/manuals/en-in/poweredge-r730/r730_ompublication/system- 
>>>> profile-settings-details?guid=guid-2e9b46a1-71e3-4072-9d86- 
>>>> db648757f0e6&lang=en-us).
>>>>
>>>> [cid:fe57df8f-3d99-4ea0-8f6e-b0daae49bb0e]
>>>> Can you please try enabling it ?
>>>
>>> You quoted the Dell PowerEdge R730. I couldn’t find it in the *Dell 
>>> PowerEdge R7625 Installation and Service Manual* [1], and also it’s 
>>> not listed in the iDRAC9 Web site (attached with added `.txt` 
>>> extension to trick the Linux list).
>>
>> The amd_pstate warning seems to be related to the perf counters 
>> warning Linux prints earlier:
>>
>>      $ dmesg --level alert,crit,err,warn
>>      [    2.666393] Spectre V2 : WARNING: Unprivileged eBPF is enabled 
>> with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
>>      [    8.109446] Could not retrieve perf counters (-19)
>>      [    9.386551] scsi 0:0:4:0: set ignore_delay_remove for 
>> handle(0x0012)
>>      [    9.487804] amd_pstate: the _CPC object is not present in 
>> SBIOS or ACPI disabled
>>      [   14.726193] wmi_bus wmi_bus-PNP0C14:00: [Firmware Bug]: WQBC 
>> data block query control method not found
>>
>> x86 maintainers, the original report with the Linux logs attached is 
>> in the archive [3].
>>
>> It looks like, there is something missing in the Dell firmware to 
>> enable the feature.
>>
>> The perf counters warning is from `amd_set_max_freq_ratio()` in `arch/ 
>> x86/kernel/acpi/cppc.c`:
>>
>> ```
>> static void amd_set_max_freq_ratio(void)
>> {
>>          struct cppc_perf_caps perf_caps;
>>          u64 numerator, nominal_perf;
>>          u64 perf_ratio;
>>          int rc;
>>
>>          rc = cppc_get_perf_caps(0, &perf_caps);
>>          if (rc) {
>>                  pr_warn("Could not retrieve perf counters (%d)\n", rc);
>>                  return;
>>          }
>>          […]
>> }
>> ```
>>
>> With
>>
>>      include/uapi/asm-generic/errno-base.h:#define    ENODEV        
>> 19    /* No such device */
>>
>> this is returned by in `drivers/acpi/cppc_acpi.c`:
>>
>> ```
>> /**
>>   * cppc_get_perf_caps - Get a CPU's performance capabilities.
>>   * @cpunum: CPU from which to get capabilities info.
>>   * @perf_caps: ptr to cppc_perf_caps. See cppc_acpi.h
>>   *
>>   * Return: 0 for success with perf_caps populated else -ERRNO.
>>   */
>> int cppc_get_perf_caps(int cpunum, struct cppc_perf_caps *perf_caps)
>> {
>>          struct cpc_desc *cpc_desc = per_cpu(cpc_desc_ptr, cpunum);
>>          […]
>>          if (!cpc_desc) {
>>                  pr_debug("No CPC descriptor for CPU:%d\n", cpunum);
>>                  return -ENODEV;
>>          }
>>          […]
>> }
>> ```
> 
> @AMD folks, just for clarity. Did Dell something with their firmware? If 
> so, are you going to work with Dell on a solution, or do I need to 
> report the issue to them?
> 

I feel if there is a BIOS bug in hardware you purchased, you should 
report a bug to the hardware creator for them to fix.


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Warnings `Could not retrieve perf counters (-19)` and `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
  2025-02-11 16:18           ` Mario Limonciello
@ 2025-03-10 15:17             ` Paul Menzel
  2025-03-18  1:29               ` Mario Limonciello
  0 siblings, 1 reply; 8+ messages in thread
From: Paul Menzel @ 2025-03-10 15:17 UTC (permalink / raw)
  To: Mario Limonciello
  Cc: Gautham Ranjal Shenoy, Ray Huang, Thomas Gleixner, Ingo Molnar,
	Borislav Petkov, Dave Hansen, x86, linux-pm, linux-acpi, LKML,
	it+linux-dell

Dear Mario,


Am 11.02.25 um 17:18 schrieb Mario Limonciello:
> On 2/11/2025 10:12, Paul Menzel wrote:

>> Am 28.01.25 um 16:08 schrieb Paul Menzel:
>>> [Cc: +x86 maintainers and ACPI list]
>>
>>> Am 28.01.25 um 11:49 schrieb Paul Menzel:
>>>
>>>> Thank you for your quick replies. Gautham, messages with HTML are 
>>>> rejected by Linux kernel lists.
>>>>
>>>>
>>>> Am 28.01.25 um 04:51 schrieb Shenoy, Gautham Ranjal:
>>>>
>>>>> As Mario mentioned, you need to enable the CPPC option. Looking for 
>>>>> some of the Dell PowerEdge documentation, there is an option called 
>>>>> "Collaborative CPU Performance Control" (https://www.dell.com/ 
>>>>> support/manuals/en-in/poweredge-r730/r730_ompublication/system- 
>>>>> profile-settings-details?guid=guid-2e9b46a1-71e3-4072-9d86- 
>>>>> db648757f0e6&lang=en-us).
>>>>>
>>>>> [cid:fe57df8f-3d99-4ea0-8f6e-b0daae49bb0e]
>>>>> Can you please try enabling it ?
>>>>
>>>> You quoted the Dell PowerEdge R730. I couldn’t find it in the *Dell 
>>>> PowerEdge R7625 Installation and Service Manual* [1], and also it’s 
>>>> not listed in the iDRAC9 Web site (attached with added `.txt` 
>>>> extension to trick the Linux list).
>>>
>>> The amd_pstate warning seems to be related to the perf counters 
>>> warning Linux prints earlier:
>>>
>>>      $ dmesg --level alert,crit,err,warn
>>>      [    2.666393] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!
>>>      [    8.109446] Could not retrieve perf counters (-19)
>>>      [    9.386551] scsi 0:0:4:0: set ignore_delay_remove for  handle(0x0012)
>>>      [    9.487804] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled
>>>      [   14.726193] wmi_bus wmi_bus-PNP0C14:00: [Firmware Bug]: WQBC data block query control method not found
>>>
>>> x86 maintainers, the original report with the Linux logs attached is 
>>> in the archive [3].
>>>
>>> It looks like, there is something missing in the Dell firmware to 
>>> enable the feature.
>>>
>>> The perf counters warning is from `amd_set_max_freq_ratio()` in 
>>> `arch/ x86/kernel/acpi/cppc.c`:
>>>
>>> ```
>>> static void amd_set_max_freq_ratio(void)
>>> {
>>>          struct cppc_perf_caps perf_caps;
>>>          u64 numerator, nominal_perf;
>>>          u64 perf_ratio;
>>>          int rc;
>>>
>>>          rc = cppc_get_perf_caps(0, &perf_caps);
>>>          if (rc) {
>>>                  pr_warn("Could not retrieve perf counters (%d)\n", rc);
>>>                  return;
>>>          }
>>>          […]
>>> }
>>> ```
>>>
>>> With
>>>
>>>      include/uapi/asm-generic/errno-base.h:#define    ENODEV 19    /* No such device */
>>>
>>> this is returned by in `drivers/acpi/cppc_acpi.c`:
>>>
>>> ```
>>> /**
>>>   * cppc_get_perf_caps - Get a CPU's performance capabilities.
>>>   * @cpunum: CPU from which to get capabilities info.
>>>   * @perf_caps: ptr to cppc_perf_caps. See cppc_acpi.h
>>>   *
>>>   * Return: 0 for success with perf_caps populated else -ERRNO.
>>>   */
>>> int cppc_get_perf_caps(int cpunum, struct cppc_perf_caps *perf_caps)
>>> {
>>>          struct cpc_desc *cpc_desc = per_cpu(cpc_desc_ptr, cpunum);
>>>          […]
>>>          if (!cpc_desc) {
>>>                  pr_debug("No CPC descriptor for CPU:%d\n", cpunum);
>>>                  return -ENODEV;
>>>          }
>>>          […]
>>> }
>>> ```
>>
>> @AMD folks, just for clarity. Did Dell something with their firmware? 
>> If so, are you going to work with Dell on a solution, or do I need to 
>> report the issue to them?
> 
> I feel if there is a BIOS bug in hardware you purchased, you should 
> report a bug to the hardware creator for them to fix.

I made the service request 205423744 on February 12th, 2025, and after 
collecting the details until February 14th, 2025, Dell replied on March 
4th, 2025, that there L3 support and engineering team was able to 
reproduce the issue, and they are going to provide a firmware update, 
currently estimated for June.

I am still surprised, that Dell’s QA overlooked this. Does AMD provide 
them test suites (does FWTS check for this). `dmesg --level=warning` is 
unfortunately not empty, so maybe they ignore it.

Would it make sense to make the warning an error, so it’s less likely 
overlooked?


Kind regards,

Paul

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: Warnings `Could not retrieve perf counters (-19)` and `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F)
  2025-03-10 15:17             ` Paul Menzel
@ 2025-03-18  1:29               ` Mario Limonciello
  0 siblings, 0 replies; 8+ messages in thread
From: Mario Limonciello @ 2025-03-18  1:29 UTC (permalink / raw)
  To: Paul Menzel
  Cc: Gautham Ranjal Shenoy, Ray Huang, Thomas Gleixner, Ingo Molnar,
	Borislav Petkov, Dave Hansen, x86, linux-pm, linux-acpi, LKML,
	it+linux-dell

<snip>
> 
> I made the service request 205423744 on February 12th, 2025, and after 
> collecting the details until February 14th, 2025, Dell replied on March 
> 4th, 2025, that there L3 support and engineering team was able to 
> reproduce the issue, and they are going to provide a firmware update, 
> currently estimated for June.
> 
> I am still surprised, that Dell’s QA overlooked this. Does AMD provide 
> them test suites (does FWTS check for this). `dmesg --level=warning` is 
> unfortunately not empty, so maybe they ignore it.
> 

IIRC FWTS doesn't test for this.  Perhaps you can add check to klog.json 
for the message you saw?  There is an existing pattern for a CPPC 
related error message:

https://github.com/fwts/fwts/blob/ec33c8ee1d99211a9cb2081324ec909a325e93d8/data/klog.json#L56

A similar pattern could be added for your case.

> Would it make sense to make the warning an error, so it’s less likely 
> overlooked?
> 

If they don't run dmesg --level=warning, why would dmesg --level=error 
would be more likely to be run?

FWIW For 6.15 we're introducing another warning for BIOS failures.

https://web.git.kernel.org/pub/scm/linux/kernel/git/superm1/linux.git/commit/?h=linux-next&id=a9ba0fd452d82ca0da170eb6291aac01075a17d5

^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2025-03-18  1:29 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-01-27 12:41 Warning `amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled` (Dell PowerEdge R7625, AMD EPYC 9174F) Paul Menzel
2025-01-27 15:43 ` Mario Limonciello
     [not found]   ` <DS7PR12MB82528A694056F1FBA20CE01E96EF2@DS7PR12MB8252.namprd12.prod.outlook.com>
2025-01-28 10:49     ` Paul Menzel
2025-01-28 15:08       ` Warnings `Could not retrieve perf counters (-19)` and " Paul Menzel
2025-02-11 16:12         ` Paul Menzel
2025-02-11 16:18           ` Mario Limonciello
2025-03-10 15:17             ` Paul Menzel
2025-03-18  1:29               ` Mario Limonciello

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox