UML not coming up on "INTEL(R) XEON(R) GOLD 6542Y"

UML not coming up on "INTEL(R) XEON(R) GOLD 6542Y"

[Vijay Tandeker]

[-- Attachment #1: Type: text/plain, Size: 1131 bytes --]



Hi, thanks to all for helping me in the past. I need one more help. Getting the below error on running UML:
----------------------------------------------------------------------------------------------
Run /sbin/init as init process
userspace - ptrace set fp regs failed, errno = 14
Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b
CPU: 0 PID: 1 Comm: init Not tainted 6.8.9-1 #1
----------------------------------------------------------------------------------------------

Searched on the internet but didn't find any solution. Any idea, what could be the reason for the above error? Below are my UML details:
1) root-fs: created by running the command: “debootstrap --arch=amd64 noble /tmp http://archive.ubuntu.com/ubuntu/”
2) Linux: created by running the command: "ARCH=um make -j$(nproc)" on linux-6.8.9 using defconfig.
3) Attached file <uml_crash>: logs on running the UML
4) Attached file <system_info>: my host system details
5) INTEL(R) XEON(R) GOLD 6542Y
6) RAM: 256 GB
7) Ubuntu 24.04.1 LTS

Please let me know if you need more information.

-- 

Thanks,
Vijay



[-- Attachment #2: uml_crash --]
[-- Type: application/octet-stream, Size: 6187 bytes --]

Core dump limits :
        soft - 0
        hard - NONE
Checking that ptrace can change system call numbers...OK
Checking syscall emulation for ptrace...OK
Checking environment variables for a tempdir.../home/vijayt/.distcc/tmp
Checking if /home/vijayt/.distcc/tmp is on tmpfs...no
Warning: tempdir /home/vijayt/.distcc/tmp is not on tmpfs
Checking PROT_EXEC mmap in /home/vijayt/.distcc/tmp...OK
Adding 22745088 bytes to physical memory to account for exec-shield gap
Linux version 6.8.9-1 (vijayt@techie-PowerEdge-R660) (gcc (Ubuntu 13.2.0-23ubuntu4) 13.2.0, GNU ld (GNU Binutils for Ubuntu) 2.42) #2 Thu Sep 12 17:49:22 IST 2024
Zone ranges:
  Normal   [mem 0x0000000000000000-0x00000000a15b0fff]
Movable zone start for each node
Early memory node ranges
  node   0: [mem 0x0000000000000000-0x00000000415b0fff]
Initmem setup node 0 [mem 0x0000000000000000-0x00000000415b0fff]
random: crng init done
Kernel command line: mem=1024M ubda=platforms/common/cowimages/cow_rootfs_240,platforms/common/fsimages/Fedora8-x86-root_fs rw root=/dev/ubda ubdc=platforms/common/cowimages/cow_etc_tejas_240,platforms/common/fsimages/etc_tejas_fs ubdd=platforms/osmc04/cowimages/cow_etc_bin_240,platforms/osmc04/fsimages/etc_bin_fs eth0=vde,/tmp/switch1,00:03:93:00:2:40 console=tty0
Unknown kernel command line parameters "mem=1024M", will be passed to user space.
Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
Sorting __ex_table...
Built 1 zonelists, mobility grouping on.  Total pages: 264037
mem auto-init: stack:all(zero), heap alloc:off, heap free:off
Memory: 1024556K/1070788K available (3608K kernel code, 970K rwdata, 1244K rodata, 154K init, 227K bss, 46232K reserved, 0K cma-reserved)
SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
NR_IRQS: 64
clocksource: timer: mask: 0xffffffffffffffff max_cycles: 0x1cd42e205, max_idle_ns: 881590404426 ns
Calibrating delay loop... 8039.62 BogoMIPS (lpj=40198144)
Checking that host ptys support output SIGIO...Yes
pid_max: default: 32768 minimum: 301
Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
devtmpfs: initialized
clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
futex hash table entries: 256 (order: 0, 6144 bytes, linear)
NET: Registered PF_NETLINK/PF_ROUTE protocol family
pps_core: LinuxPPS API ver. 1 registered
pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
PTP clock support registered
clocksource: Switched to clocksource timer
VFS: Disk quotas dquot_6.6.0
VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
NET: Registered PF_INET protocol family
IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)
tcp_listen_portaddr_hash hash table entries: 1024 (order: 1, 8192 bytes, linear)
Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)
TCP bind hash table entries: 16384 (order: 6, 262144 bytes, linear)
TCP: Hash tables configured (established 16384 bind 16384)
UDP hash table entries: 1024 (order: 3, 32768 bytes, linear)
UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear)
NET: Registered PF_UNIX/PF_LOCAL protocol family
printk: legacy console [stderr0] disabled
mconsole (version 2) initialized on /home/vijayt/.uml/um240/mconsole
Checking host MADV_REMOVE support...OK
workingset: timestamp_bits=62 max_order=18 bucket_order=0
io scheduler mq-deadline registered
io scheduler kyber registered
NET: Registered PF_PACKET protocol family
Initialized stdio console driver
Console initialized on /dev/tty0
printk: legacy console [tty0] enabled
Initializing software serial port version 1
printk: legacy console [mc-1] enabled
winch_thread : TIOCSCTTY failed on fd 1 err = 1
                                               EXT4-fs (ubda): recovery complete
EXT4-fs (ubda): mounted filesystem 71a7036d-eb1d-491e-bd4d-df31be53e0a1 r/w with ordered data mode. Quota mode: none.
VFS: Mounted root (ext4 filesystem) on device 98:0.
devtmpfs: mounted
This architecture does not have kernel memory protection.
Run /sbin/init as init process
userspace - ptrace set fp regs failed, errno = 14
Kernel panic - not syncing: Attempted to kill init! exitcode=0x0000000b
CPU: 0 PID: 1 Comm: init Not tainted 6.8.9-1 #2
Stack:
 a1803bb0 6038083e 00000001 00000000
 00000001 60463c18 603993d2 00000001
 a1803be0 603a0d31 60514810 6045957a
Call Trace:
 [<603993d2>] ? _printk+0x0/0x98
 [<600228a4>] show_stack+0x102/0x15d
 [<6038083e>] ? dump_stack_print_info+0xe5/0xf4
 [<603993d2>] ? _printk+0x0/0x98
 [<603a0d31>] dump_stack_lvl+0x62/0x7d
 [<603a0d6a>] dump_stack+0x1e/0x20
 [<603984a7>] panic+0x1ae/0x38d
 [<60034ada>] ? um_set_signals+0x2a/0x3e
 [<603982f9>] ? panic+0x0/0x38d
 [<601446cd>] ? do_coredump+0x13ba/0x13d9
 [<60034ae8>] ? um_set_signals+0x38/0x3e
 [<60034ada>] ? um_set_signals+0x2a/0x3e
 [<60034ab0>] ? um_set_signals+0x0/0x3e
 [<60047170>] ? percpu_up_read.constprop.0+0x3e/0x6d
 [<600349ef>] ? unblock_signals+0x0/0xc1
 [<600349dc>] ? block_signals+0x0/0x13
 [<6003fd87>] do_exit+0x236/0x9bd
 [<600e1f55>] ? __update_cpu_freelist_fast+0x59/0x67
 [<600349dc>] ? block_signals+0x0/0x13
 [<600407a1>] sys_exit_group+0x0/0x1a
 [<6004b1d6>] get_signal+0x8c9/0x8ee
 [<6004a90d>] ? get_signal+0x0/0x8ee
 [<60022706>] do_signal+0x39/0xd5
 [<60023bce>] fatal_sigsegv+0x3d/0x49
 [<60039d93>] ? put_fp_registers+0x14/0x16
 [<60037620>] userspace+0xc9/0x4ad
 [<6005854c>] ? parameq+0x0/0x3a
 [<60397c00>] ? try_to_run_init_process+0x0/0x48
 [<600216d3>] new_thread_handler+0xb2/0xb4
platforms/common/runuml.sh: line 37: 3571188 Aborted                 (core dumped) $UMLINUX umid=um$UMLID mem=$RAM ubda=${COMN_COW_DIR}/cow_rootfs_$UMLID,${COMN_FS_DIR}/Fedora8-x86-root_fs rw root=/dev/ubda ubdc=${COMN_COW_DIR}/cow_etc_tejas_$UMLID,${COMN_FS_DIR}/etc_tejas_fs ubdd=$COW_DIR/cow_etc_bin_$UMLID,$FS_DIR/etc_bin_fs eth0=vde,/tmp/switch1,$UML_MAC
                                 [vijayt@techie-PowerEdge-R660:huml]$

[-- Attachment #3: system_info --]
[-- Type: application/octet-stream, Size: 2394 bytes --]

cat /proc/cpuinfo
processor   : 0
vendor_id   : GenuineIntel
cpu family  : 6
model       : 207
model name  : INTEL(R) XEON(R) GOLD 6542Y
stepping    : 2
microcode   : 0x21000240
cpu MHz     : 800.000
cache size  : 61440 KB
physical id : 0
siblings    : 48
core id     : 0
cpu cores   : 24
apicid      : 0
initial apicid  : 0
fpu     : yes
fpu_exception   : yes
cpuid level : 32
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3 cdp_l2 ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local split_lock_detect user_shstk avx_vnni avx512_bf16 wbnoinvd dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req hfi vnmi avx512vbmi umip pku ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid bus_lock_detect cldemote movdiri movdir64b enqcmd fsrm md_clear serialize tsxldtrk pconfig arch_lbr ibt amx_bf16 avx512_fp16 amx_tile amx_int8 flush_l1d arch_capabilities
vmx flags   : vnmi preemption_timer posted_intr invvpid ept_x_only ept_ad ept_1gb flexpriority apicv tsc_offset vtpr mtf vapic ept vpid unrestricted_guest vapic_reg vid ple shadow_vmcs pml ept_mode_based_exec tsc_scaling usr_wait_pause notify_vm_exiting ipi_virt
bugs        : spectre_v1 spectre_v2 spec_store_bypass swapgs eibrs_pbrsb bhi
bogomips    : 5800.00
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 57 bits virtual
power management:

[vijayt@techie-PowerEdge-R660:L68_DEF_TARGET]$ free -h
               total        used        free      shared  buff/cache   available
Mem:           251Gi       8.0Gi       239Gi        23Mi       5.8Gi       243Gi
Swap:           47Gi          0B        47Gi

Re: UML not coming up on "INTEL(R) XEON(R) GOLD 6542Y"

[Benjamin Berg]

Hi,

if it is really only on that CPU, then maybe it is related to AMX
support? Though, not sure how exactly that might be affecting
PTRACE_{S,G}ETFPREGS on x86_64.

Benjamin

On Mon, 2024-09-16 at 13:09 +0000, Vijay Tandeker wrote:
> 
> 
> Hi, thanks to all for helping me in the past. I need one more help.
> Getting the below error on running UML:
> ---------------------------------------------------------------------
> -------------------------
> Run /sbin/init as init process
> userspace - ptrace set fp regs failed, errno = 14
> Kernel panic - not syncing: Attempted to kill init!
> exitcode=0x0000000b
> CPU: 0 PID: 1 Comm: init Not tainted 6.8.9-1 #1
> ---------------------------------------------------------------------
> -------------------------
> 
> Searched on the internet but didn't find any solution. Any idea, what
> could be the reason for the above error? Below are my UML details:
> 1) root-fs: created by running the command: “debootstrap --arch=amd64
> noble /tmp http://archive.ubuntu.com/ubuntu/”
> 2) Linux: created by running the command: "ARCH=um make -j$(nproc)"
> on linux-6.8.9 using defconfig.
> 3) Attached file <uml_crash>: logs on running the UML
> 4) Attached file <system_info>: my host system details
> 5) INTEL(R) XEON(R) GOLD 6542Y
> 6) RAM: 256 GB
> 7) Ubuntu 24.04.1 LTS
> 
> Please let me know if you need more information.
> 

Re: UML not coming up on "INTEL(R) XEON(R) GOLD 6542Y"

[Benjamin Berg]

Hi,

On Tue, 2024-09-17 at 10:08 +0200, Benjamin Berg wrote:
> if it is really only on that CPU, then maybe it is related to AMX
> support? Though, not sure how exactly that might be affecting
> PTRACE_{S,G}ETFPREGS on x86_64.

Just, FYI, it really cannot work if the host kernel has AMX enabled.
The reason is that PTRACE_SETREGSET on NT_X86_XSAVE expects that the
passed buffer has the maximum theoretical size (I suppose even if the
feature isn't even enabled for the process).

Seems like the only way to make this work is to discover the xstate
size from the host kernel. I guess by passing a very large buffer to
PTRACE_GETREGSET and checking the iovec for the filled in length.

I think you can work around it by setting
  clearcpuid=amx_tile
on the host kernel command line.

Benjamin


> On Mon, 2024-09-16 at 13:09 +0000, Vijay Tandeker wrote:
> > 
> > 
> > Hi, thanks to all for helping me in the past. I need one more help.
> > Getting the below error on running UML:
> > -------------------------------------------------------------------
> > --
> > -------------------------
> > Run /sbin/init as init process
> > userspace - ptrace set fp regs failed, errno = 14
> > Kernel panic - not syncing: Attempted to kill init!
> > exitcode=0x0000000b
> > CPU: 0 PID: 1 Comm: init Not tainted 6.8.9-1 #1
> > -------------------------------------------------------------------
> > --
> > -------------------------
> > 
> > Searched on the internet but didn't find any solution. Any idea,
> > what
> > could be the reason for the above error? Below are my UML details:
> > 1) root-fs: created by running the command: “debootstrap --
> > arch=amd64
> > noble /tmp http://archive.ubuntu.com/ubuntu/”
> > 2) Linux: created by running the command: "ARCH=um make -j$(nproc)"
> > on linux-6.8.9 using defconfig.
> > 3) Attached file <uml_crash>: logs on running the UML
> > 4) Attached file <system_info>: my host system details
> > 5) INTEL(R) XEON(R) GOLD 6542Y
> > 6) RAM: 256 GB
> > 7) Ubuntu 24.04.1 LTS
> > 
> > Please let me know if you need more information.
> > 
> 
> 
>