[Qemu-devel] [help] error: when install on nest-kvm

[Sheldon <shaohef@linux.vnet.ibm.com>]

[-- Attachment #1: Type: text/plain, Size: 1823 bytes --]

Hi all,

There is a error when I install a RHEL or FC17 os on my nest-kvm.

I find some error in the qemu log( attachment) as follow:
KVM: entry failed, hardware error 0x7


so I check the related code in kvm.c.

int kvm_arch_handle_exit(CPUX86State *env, struct kvm_run *run)
{
uint64_t code;
int ret;

switch (run->exit_reason) {
...
case KVM_EXIT_FAIL_ENTRY:
code = run->fail_entry.hardware_entry_failure_reason;
fprintf(stderr, "KVM: entry failed, hardware error 0x%" PRIx64 "\n",
code);
if (host_supports_vmx() && code == VMX_INVALID_GUEST_STATE) {
fprintf(stderr,
"\nIf you're running a guest on an Intel machine without "
"unrestricted mode\n"
"support, the failure can be most likely due to the guest "
"entering an invalid\n"
"state for Intel VT. For example, the guest maybe running "
"in big real mode\n"
"which is not supported on less recent Intel processors."
"\n\n");
}
ret = -1;
break;
case KVM_EXIT_EXCEPTION:
...
}

 From the code, I'm not sure error is caused by nest kvm.
for the hardware_entry_failure_reason is 0x7 not VMX_INVALID_GUEST_STATE.
but I'm not find where the hardware_entry_failure_reason is set. I doubt 
it is set by KVM module in kernel.

here is the environment:
the guest hypervisor, a nest-kvm VM, OS is 3.6.1-1.fc17.x86_64. And it 
does support VT.
$ sudo cat /proc/cpuinfo |grep vmx
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge
mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb
rdtscp lm constant_tsc arch_perfmon rep_good nopl pni pclmulqdq vmx
ssse3 cx16 sse4_1 sse4_2 popcnt aes hypervisor lahf_lm

The host: OS is 3.6.1-1.fc17.x86_64. CPU is Intel(R) Xeon(R) CPU X5650. 
The host also opens the nested switch.
$ cat /sys/module/kvm_intel/parameters/nested
Y

-- 
Sheldon Feng(冯少合)<shaohef@linux.vnet.ibm.com>
IBM Linux Technology Center


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: qemu.log --]
[-- Type: text/x-log; name="qemu.log", Size: 3701 bytes --]

2012-11-01 09:48:17.317+0000: starting up
LC_ALL=C PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin QEMU_AUDIO_DRV=none /usr/bin/qemu-kvm -name guest1 -S -M pc-0.14 -cpu Westmere -enable-kvm -m 1024 -smp 1,sockets=1,cores=1,threads=1 -uuid bd1ed1d6-28c9-45f0-92c2-7b133243fe51 -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=17-1,serial=2D138CD3-67D1-3683-8B45-55F8B68CF49C_52:54:00:26:7c:bf,uuid=bd1ed1d6-28c9-45f0-92c2-7b133243fe51 -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/guest1.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2012-10-31T21:48:17,driftfix=slew -no-shutdown -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-serial-pci,id=virtio-serial0,bus=pci.0,addr=0x4 -drive file=/rhev/data-center/67481e14-48a2-4879-a23b-09820c56c840/f464cd45-d725-43bf-a3b3-0bc28f5706aa/images/11111111-1111-1111-1111-111111111111/RHEL6.3-20120531.0-Server-x86_64-DVD1.iso,if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0,bootindex=1 -drive file=/rhev/data-center/67481e14-48a2-4879-a23b-09820c56c840/d0dc2048-cc38-42c2-ae3b-c716bb7e6c89/images/1d7bcfe8-da26-4299-888f-c1add2477485/7df2f9b0-99e4-4c9d-8e1e-6fb845517943,if=none,id=drive-virtio-disk0,format=qcow2,serial=1d7bcfe8-da26-4299-888f-c1add2477485,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x5,drive=drive-virtio-disk0,id=virtio-disk0 -netdev tap,fd=28,id=hostnet0,vhost=on,vhostfd=29 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:1a:4a:a8:7a:09,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/guest1.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/guest1.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -device usb-tablet,id=input0 -vnc 0:0,password -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x6
char device redirected to /dev/pts/0
KVM: entry failed, hardware error 0x7
RAX=000000000000000f RBX=000000000000038f RCX=000000000000038f RDX=0000000000000000
RSI=000000000000000f RDI=000000000000038f RBP=ffff88003d2f5a90 RSP=ffff88003d2f5a90
R8 =0000000000000000 R9 =0000000000000001 R10=0000000000000001 R11=0000000000000001
R12=ffffffff81602880 R13=0000000000000000 R14=0000000000000000 R15=ffff88003d2f5adc
RIP=ffffffff8103890a RFL=00000046 [---Z-P-] CPL=0 II=0 A20=1 SMM=0 HLT=0
ES =0018 0000000000000000 ffffffff 00c09300 DPL=0 DS   [-WA]
CS =0010 0000000000000000 ffffffff 00a09b00 DPL=0 CS64 [-RA]
SS =0018 0000000000000000 ffffffff 00c09300 DPL=0 DS   [-WA]
DS =0018 0000000000000000 ffffffff 00c09300 DPL=0 DS   [-WA]
FS =0000 0000000000000000 000fffff 00000000
GS =0000 ffff880002200000 000fffff 00000000
LDT=0000 0000000000000000 000fffff 00000000
TR =0040 ffff880002214200 00002087 00008b00 DPL=0 TSS64-busy
GDT=     ffff880002204000 0000007f
IDT=     ffffffff81dd7000 00000fff
CR0=8005003b CR2=0000000000000000 CR3=0000000001a85000 CR4=000006f0
DR0=0000000000000000 DR1=0000000000000000 DR2=0000000000000000 DR3=0000000000000000 
DR6=00000000ffff0ff0 DR7=0000000000000400
EFER=0000000000000d01
Code=66 2e 0f 1f 84 00 00 00 00 00 55 89 f0 89 f9 48 89 e5 0f 30 <31> c0 c9 c3 66 90 55 48 89 e5 0f 1f 44 00 00 89 f9 0f 33 89 c7 48 89 d0 48 c1 e0 20 89 f9