Re: All kernels after 2.6.32-git10 show only 1 CPU

[Sid Boyce <sboyce@blueyonder.co.uk>]

On 25/12/09 07:38, Yinghai Lu wrote:
> On Wed, Dec 23, 2009 at 8:55 AM, Sid Boyce <sboyce@blueyonder.co.uk> wrote:
>> On the 4P box, 2.6.32-git10 boots and shows 4 CPU's, 2.6.32-git12 boots
>> and shows 1 CPU, 2.6.32-git15 to 2.6.33-rc1-git3 1 CPU and lots of oops,
>> continues with something like "Sending NMI interrupts to CPU's",
>> [udev] unexpectedly returned with status 0x0100
>> [udev] failed while handling /devices/pci000:00 -----etc--- same for
>> other devices.
>> Unable to capture via serial console as USB doesn't come ready.
>>
>> On 2P laptop, up to 2.6.33-rc1 boots, 1 CPU and boot option "acpi=noirq"
>> needed, without it boot hangs, I think from 2.6.32-git15.
>>  Building kernels, I have used the .config from previous kernel and
>> "make oldconfig".
>>
>> # uname -r
>> 2.6.32-git12-smp
>> slipstream:~ # cat /proc/cpuinfo
>> processor       : 0
>> vendor_id       : AuthenticAMD
>> cpu family      : 16
>> model           : 4
>> model name      : AMD Phenom(tm) II X4 940 Processor
>> stepping        : 2
>> cpu MHz         : 3013.597
>> cache size      : 512 KB
>> physical id     : 0
>> siblings        : 1
>> core id         : 0
>> cpu cores       : 1
>> apicid          : 0
>> initial apicid  : 0
>> fpu             : yes
>> fpu_exception   : yes
>> cpuid level     : 5
>> wp              : yes
>> flags           : fpu vme de pse tsc msr pae mce cx8 sep mtrr pge mca
>> cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt
>> pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc up rep_good nonstop_tsc
>> pni monitor cx16 popcnt lahf_lm cmp_legacy svm extapic cr8_legacy abm
>> sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt
>> bogomips        : 6027.18
>> TLB size        : 1024 4K pages
>> clflush size    : 64
>> cache_alignment : 64
>> address sizes   : 48 bits physical, 48 bits virtual
>> power management: ts ttp tm stc 100mhzsteps hwpstate
>>
>> # uname -r
>> 2.6.32-git10-smp
>>
>> # cat /proc/cpuinfo
>> processor       : 0
>> vendor_id       : AuthenticAMD
>> cpu family      : 16
>> model           : 4
>> model name      : AMD Phenom(tm) II X4 940 Processor
>> stepping        : 2
>> cpu MHz         : 3013.774
>> cache size      : 512 KB
>> physical id     : 0
>> siblings        : 4
>> core id         : 0
>> cpu cores       : 4
>> apicid          : 0
>> initial apicid  : 0
>> fpu             : yes
>> fpu_exception   : yes
>> cpuid level     : 5
>> wp              : yes
>> flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
>> mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext
>> fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good
>> nonstop_tsc extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm
>> extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt
>> bogomips        : 6027.53
>> TLB size        : 1024 4K pages
>> clflush size    : 64
>> cache_alignment : 64
>> address sizes   : 48 bits physical, 48 bits virtual
>> power management: ts ttp tm stc 100mhzsteps hwpstate
>>
>> processor       : 1
>> vendor_id       : AuthenticAMD
>> cpu family      : 16
>> model           : 4
>> model name      : AMD Phenom(tm) II X4 940 Processor
>> stepping        : 2
>> cpu MHz         : 3013.774
>> cache size      : 512 KB
>> physical id     : 0
>> siblings        : 4
>> core id         : 1
>> cpu cores       : 4
>> apicid          : 1
>> initial apicid  : 1
>> fpu             : yes
>> fpu_exception   : yes
>> cpuid level     : 5
>> wp              : yes
>> flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
>> mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext
>> fxsr_opt pdpe1gb rdtscp lm 3dnowext 3dnow constant_tsc rep_good
>> nonstop_tsc extd_apicid pni monitor cx16 popcnt lahf_lm cmp_legacy svm
>> extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw ibs skinit wdt
>> bogomips        : 6027.27
>> TLB size        : 1024 4K pages
>> clflush size    : 64
>> cache_alignment : 64
>> address sizes   : 48 bits physical, 48 bits virtual
>> power management: ts ttp tm stc 100mhzsteps hwpstate
>>
>> etc., up to processor 4.
>>
>> On a 2P laptop
>> ===============
>> tindog:~ # uname -r
>> 2.6.33-rc1-smp
>>
>> tindog:~ # cat /proc/cpuinfo
>> processor       : 0
>> vendor_id       : AuthenticAMD
>> cpu family      : 15
>> model           : 67
>> model name      : AMD Athlon(tm) 64 X2 Dual Core Processor 6000+
>> stepping        : 3
>> cpu MHz         : 1000.000
>> cache size      : 1024 KB
>> physical id     : 0
>> siblings        : 1
>> core id         : 0
>> cpu cores       : 1
>> apicid          : 0
>> initial apicid  : 0
>> fpu             : yes
>> fpu_exception   : yes
>> cpuid level     : 1
>> wp              : yes
>> flags           : fpu vme de pse tsc msr pae mce cx8 sep mtrr pge mca
>> cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt
>> rdtscp lm 3dnowext 3dnow up rep_good pni cx16 lahf_lm cmp_legacy svm
>> extapic cr8_legacy
>> bogomips        : 2009.33
>> TLB size        : 1024 4K pages
>> clflush size    : 64
>> cache_alignment : 64
>> address sizes   : 40 bits physical, 48 bits virtual
>> power management: ts fid vid ttp tm stc
>>
>> The .config for the 4P and 2.6.33-rc1-git3 attached.
> 
> Can you disable MAXSMP?
> 
> YH
> 
> 
tindog:/usr/src/linux-2.6.33-rc2 # grep MAXSMP .config
# CONFIG_MAXSMP is not set

tindog:/usr/src/linux-2.6.33-rc2 # grep NUMA .config
# CONFIG_NUMA is not set
tindog:/usr/src/linux-2.6.33-rc2 # grep NUMA
/usr/src/linux-2.6.33-rc1-git2/.config
CONFIG_NUMA=y
CONFIG_K8_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
CONFIG_NUMA_EMU=y
CONFIG_ACPI_NUMA=y
tindog:/usr/src/linux-2.6.33-rc2 #
tindog:/usr/src # grep NUMA linux-2.6.33-rc2/.config
CONFIG_NUMA=y
CONFIG_K8_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
# CONFIG_NUMA_EMU is not set
CONFIG_ACPI_NUMA=y
The above is the 2P box showing just 1 CPU.
Booting from an install DVD into rescue or booting the openSUSE kernel
2.6.32-3-default I have 2 CPU's.
-----------------------------------------------------------------------
Below is the 4P box which shows 4 CPU's.
slipstream:/usr/src/linux-2.6.33-rc2 # grep MAXSMP .config
# CONFIG_MAXSMP is not set

slipstream:/usr/src/linux-2.6.33-rc2 # grep NUMA .config
CONFIG_NUMA=y
CONFIG_K8_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
# CONFIG_NUMA_EMU is not set
CONFIG_ACPI_NUMA=y
slipstream:/usr/src/linux-2.6.33-rc2 #

I decided to use the config from the openSUSE kernel as the basis of a
new .config and 2.6.33-rc2 now shows 2 CPU's. Later I shall do a diff to
see if anything stands out.
tindog:~ # uname -r
2.6.33-rc2-smp
tindog:~ # cat /proc/cpuinfo
processor       : 0
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 67
model name      : AMD Athlon(tm) 64 X2 Dual Core Processor 6000+
stepping        : 3
cpu MHz         : 1000.000
cache size      : 1024 KB
physical id     : 0
siblings        : 2
core id         : 0
cpu cores       : 2
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext
fxsr_opt rdtscp lm 3dnowext 3dnow rep_good extd_apicid pni cx16 lahf_lm
cmp_legacy svm extapic cr8_legacy
bogomips        : 2009.06
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp tm stc

processor       : 1
vendor_id       : AuthenticAMD
cpu family      : 15
model           : 67
model name      : AMD Athlon(tm) 64 X2 Dual Core Processor 6000+
stepping        : 3
cpu MHz         : 1000.000
cache size      : 1024 KB
physical id     : 0
siblings        : 2
core id         : 1
cpu cores       : 2
apicid          : 1
initial apicid  : 1
fpu             : yes
fpu_exception   : yes
cpuid level     : 1
wp              : yes
flags           : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext
fxsr_opt rdtscp lm 3dnowext 3dnow rep_good extd_apicid pni cx16 lahf_lm
cmp_legacy svm extapic cr8_legacy
bogomips        : 2009.06
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
power management: ts fid vid ttp tm stc
tindog:/usr/src/linux-2.6.33-rc2 # grep MAXSMP .config
# CONFIG_MAXSMP is not set
tindog:/usr/src/linux-2.6.33-rc2 # grep NUMA .config
CONFIG_NUMA_IRQ_DESC=y   <<====== One difference.
CONFIG_NUMA=y
CONFIG_K8_NUMA=y
CONFIG_X86_64_ACPI_NUMA=y
CONFIG_NUMA_EMU=y
CONFIG_ACPI_NUMA=y

Regards
Sid.
-- 
Sid Boyce ... Hamradio License G3VBV, Licensed Private Pilot
Emeritus IBM/Amdahl Mainframes and Sun/Fujitsu Servers Tech Support
Specialist, Cricket Coach
Microsoft Windows Free Zone - Linux used for all Computing Tasks