From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jeroen Groenewegen van der Weyden Subject: Crash of guest with nested vmx with Unknown nested vmexit reason 80000021. Date: Tue, 30 Sep 2014 17:55:18 +0200 Message-ID: <542AD266.5030803@grosc.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8160884411326514079==" Return-path: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: xen-devel@lists.xen.org List-Id: xen-devel@lists.xenproject.org This is a multi-part message in MIME format. --===============8160884411326514079== Content-Type: multipart/alternative; boundary="------------080804040609080103070601" This is a multi-part message in MIME format. --------------080804040609080103070601 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Hi, Recently I updated my openSuse box from 12.3 to 13.1. On this box I run xen with several guests. One of these guests is an appliance that has 4 kvm guests running. When I start this appliance with the nested vmx feature the appliance crashes either immediately or after a few minutes. This same guest was running without a problem on opensuse releases 11.4 until 12.3 ( remark that about 3 year ago some patches were written by tim degan to make this appliance work ) dom0 opensuse 13.1 x86 kernel 3.11.10-21-xen xen: 4.3..2_01-21.1 - domu (HVM) - sles11sp2 - mem: 8 GB - vcpu: 4 - kvm with 4 guest any body any thought on this? BR, Jeroen ==== outup xl demsg (XEN) vvmx.c:2459:d5 Unknown nested vmexit reason 80000021. (XEN) Failed vm entry (exit reason 0x80000021) caused by invalid guest state (0). (XEN) ************* VMCS Area ************** (XEN) *** Guest State *** (XEN) CR0: actual=0x0000000080000033, shadow=0x0000000000000011, gh_mask=ffffffffffffffff (XEN) CR4: actual=0x0000000000002050, shadow=0x0000000000000000, gh_mask=ffffffffffffffff (XEN) CR3: actual=0x00000000feffc000, target_count=0 (XEN) target0=0000000000000000, target1=0000000000000000 (XEN) target2=0000000000000000, target3=0000000000000000 (XEN) RSP = 0x0000000000000398 (0x0000000000000398) RIP = 0x000000000000045f (0x000000000000045f) (XEN) RFLAGS=0x0000000000000006 (0x0000000000000006) DR7 = 0x0000000000000400 (XEN) Sysenter RSP=0000000000000000 CS:RIP=0000:0000000000000000 (XEN) CS: sel=0x9dcc, attr=0x0009b, limit=0x00000ecb, base=0x0000000000689920 (XEN) DS: sel=0x9db4, attr=0x00093, limit=0x000038b9, base=0x00000000006778b0 (XEN) SS: sel=0x9e7c, attr=0x00093, limit=0x00000401, base=0x00000000006ba960 (XEN) ES: sel=0x3ec8, attr=0x00093, limit=0x00000099, base=0x000000000073c608 (XEN) FS: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0x0000000000000000 (XEN) GS: sel=0x0000, attr=0x1c000, limit=0xffffffff, base=0x0000000000000000 (XEN) GDTR: limit=0x0000ffff, base=0x0000000001000000 (XEN) LDTR: sel=0x0820, attr=0x00082, limit=0x0000ffff, base=0x0000000001010400 (XEN) IDTR: limit=0x000003ff, base=0x0000000001010000 (XEN) TR: sel=0x0690, attr=0x00083, limit=0x0000002b, base=0x0000000001213a30 (XEN) Guest PAT = 0x0000050100070406 (XEN) TSC Offset = fffd869460e8dc28 (XEN) DebugCtl=0000000000000000 DebugExceptions=0000000000000000 (XEN) Interruptibility=0008 ActivityState=0000 (XEN) *** Host State *** (XEN) RSP = 0xffff83083ff27f90 RIP = 0xffff82c4c01d9330 (XEN) CS=e008 DS=0000 ES=0000 FS=0000 GS=0000 SS=0000 TR=e040 (XEN) FSBase=0000000000000000 GSBase=0000000000000000 TRBase=ffff83083ff2dc80 (XEN) GDTBase=ffff8318035ee000 IDTBase=ffff8318035fa000 (XEN) CR0=0000000080050033 CR3=0000000eefcc0000 CR4=00000000000026f0 (XEN) Sysenter RSP=ffff83083ff27fc0 CS:RIP=e008:ffff82c4c0216c60 (XEN) Host PAT = 0x0000050100070406 (XEN) *** Control State *** (XEN) PinBased=0000003f CPUBased=b6b9e5fa SecondaryExec=000004eb (XEN) EntryControls=000011ff ExitControls=000fefff (XEN) ExceptionBitmap=00040042 (XEN) VMEntry: intr_info=80000202 errcode=5d021101 ilen=00000003 (XEN) VMExit: intr_info=00000000 errcode=00000000 ilen=00000003 (XEN) reason=80000021 qualification=00000000 (XEN) IDTVectoring: info=80000202 errcode=00000000 (XEN) TPR Threshold = 0x00 (XEN) EPT pointer = 0x0000000ef022501e (XEN) Virtual processor ID = 0xc0d0 (XEN) ************************************** (XEN) domain_crash called from vmx.c:2342 (XEN) Domain 5 (vcpu#3) crashed on cpu#20: (XEN) ----[ Xen-4.3.2_01-21.1 x86_64 debug=n Not tainted ]---- (XEN) CPU: 20 (XEN) RIP: 9dcc:[<000000000000045f>] (XEN) RFLAGS: 0000000000000006 CONTEXT: hvm guest (XEN) rax: 0000000000000001 rbx: 00000000000026db rcx: 000000009dd40003 (XEN) rdx: 00000000248816a0 rsi: 0000000000000000 rdi: 0000000026b010e4 (XEN) rbp: 00000000000003ae rsp: 0000000000000398 r8: 0000000000000000 (XEN) r9: 0000000000000000 r10: 0000000000000000 r11: 0000000000000000 (XEN) r12: 0000000000000000 r13: 0000000000000000 r14: 0000000000000000 (XEN) r15: 0000000000000000 cr0: 0000000080000033 cr4: 0000000000002010 (XEN) cr3: 00000000feffc000 cr2: 0000000000000000 (XEN) ds: 9db4 es: 3ec8 fs: 0000 gs: 0000 ss: 9e7c cs: 9dcc --------------080804040609080103070601 Content-Type: text/html; charset=windows-1252 Content-Length: 6092 Content-Transfer-Encoding: quoted-printable Hi,

Recently I updated my openSuse box from 12.3 to 13.1. On this box I run xen with several guests. One of these guests is an appliance that has 4 kvm guests running.
When I start this appliance with the nested vmx feature the appliance crashes either immediately or after a few minutes.

This same guest was running without a problem on opensuse releases 11.4 until 12.3
( remark that about 3 year ago some patches were written by tim degan to make this appliance work )

dom0
opensuse 13.1 x86
kernel 3.11.10-21-xen
xen: 4.3..2_01-21.1

- domu (HVM)
- sles11sp2
- mem: 8 GB
- vcpu: 4
- kvm with 4 guest
any body any thought on this=3F

BR,
Jeroen


=3D=3D=3D=3D outup xl demsg
(XEN) vvmx.c:2459:d5 Unknown nested vmexit reason 80000021.
(XEN) Failed vm entry (exit reason 0x80000021) caused by invalid guest state (0).
(XEN) ************* VMCS Area **************
(XEN) *** Guest State ***
(XEN) CR0: actual=3D0x0000000080000033, shadow=3D0x0000000000000011, gh_mask=3Dffffffffffffffff
(XEN) CR4: actual=3D0x0000000000002050, shadow=3D0x0000000000000000, gh_mask=3Dffffffffffffffff
(XEN) CR3: actual=3D0x00000000feffc000, target_count=3D0
(XEN)=A0=A0=A0=A0=A0 target0=3D0000000000000000, target1=3D0000000000000000
(XEN)=A0=A0=A0=A0=A0 target2=3D0000000000000000, target3=3D0000000000000000
(XEN) RSP =3D 0x0000000000000398 (0x0000000000000398)=A0 RIP =3D 0x000000000000045f (0x000000000000045f)
(XEN) RFLAGS=3D0x0000000000000006 (0x0000000000000006)=A0 DR7 =3D 0x0000000000000400
(XEN) Sysenter RSP=3D0000000000000000 CS:RIP=3D0000:0000000000000000
(XEN) CS: sel=3D0x9dcc, attr=3D0x0009b, limit=3D0x00000ecb, base=3D0x0000000000689920
(XEN) DS: sel=3D0x9db4, attr=3D0x00093, limit=3D0x000038b9, base=3D0x00000000006778b0
(XEN) SS: sel=3D0x9e7c, attr=3D0x00093, limit=3D0x00000401, base=3D0x00000000006ba960
(XEN) ES: sel=3D0x3ec8, attr=3D0x00093, limit=3D0x00000099, base=3D0x000000000073c608
(XEN) FS: sel=3D0x0000, attr=3D0x1c000, limit=3D0xffffffff, base=3D0x0000000000000000
(XEN) GS: sel=3D0x0000, attr=3D0x1c000, limit=3D0xffffffff, base=3D0x0000000000000000
(XEN) GDTR:=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 limit=3D0x0000ffff, base=3D0x0000000001000000
(XEN) LDTR: sel=3D0x0820, attr=3D0x00082, limit=3D0x0000ffff, base=3D0x0000000001010400
(XEN) IDTR:=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 limit=3D0x000003ff, base=3D0x0000000001010000
(XEN) TR: sel=3D0x0690, attr=3D0x00083, limit=3D0x0000002b, base=3D0x0000000001213a30
(XEN) Guest PAT =3D 0x0000050100070406
(XEN) TSC Offset =3D fffd869460e8dc28
(XEN) DebugCtl=3D0000000000000000 DebugExceptions=3D0000000000000000
(XEN) Interruptibility=3D0008 ActivityState=3D0000
(XEN) *** Host State ***
(XEN) RSP =3D 0xffff83083ff27f90=A0 RIP =3D 0xffff82c4c01d9330
(XEN) CS=3De008 DS=3D0000 ES=3D0000 FS=3D0000 GS=3D0000 SS=3D0000 TR=3De040
(XEN) FSBase=3D0000000000000000 GSBase=3D0000000000000000 TRBase=3Dffff83083ff2dc80
(XEN) GDTBase=3Dffff8318035ee000 IDTBase=3Dffff8318035fa000
(XEN) CR0=3D0000000080050033 CR3=3D0000000eefcc0000 CR4=3D00000000000026f0
(XEN) Sysenter RSP=3Dffff83083ff27fc0 CS:RIP=3De008:ffff82c4c0216c60
(XEN) Host PAT =3D 0x0000050100070406
(XEN) *** Control State ***
(XEN) PinBased=3D0000003f CPUBased=3Db6b9e5fa SecondaryExec=3D000004eb
(XEN) EntryControls=3D000011ff ExitControls=3D000fefff
(XEN) ExceptionBitmap=3D00040042
(XEN) VMEntry: intr_info=3D80000202 errcode=3D5d021101 ilen=3D00000003
(XEN) VMExit: intr_info=3D00000000 errcode=3D00000000 ilen=3D00000003
(XEN)=A0=A0=A0=A0=A0=A0=A0=A0 reason=3D80000021 qualification=3D00000000
(XEN) IDTVectoring: info=3D80000202 errcode=3D00000000
(XEN) TPR Threshold =3D 0x00
(XEN) EPT pointer =3D 0x0000000ef022501e
(XEN) Virtual processor ID =3D 0xc0d0
(XEN) **************************************
(XEN) domain_crash called from vmx.c:2342
(XEN) Domain 5 (vcpu#3) crashed on cpu#20:
(XEN) ----[ Xen-4.3.2_01-21.1=A0 x86_64=A0 debug=3Dn=A0 Not tainted ]----
(XEN) CPU:=A0=A0=A0 20
(XEN) RIP:=A0=A0=A0 9dcc:[<000000000000045f>]
(XEN) RFLAGS: 0000000000000006=A0=A0 CONTEXT: hvm guest
(XEN) rax: 0000000000000001=A0=A0 rbx: 00000000000026db=A0=A0 rcx: 000000009dd40003
(XEN) rdx: 00000000248816a0=A0=A0 rsi: 0000000000000000=A0=A0 rdi: 0000000026b010e4
(XEN) rbp: 00000000000003ae=A0=A0 rsp: 0000000000000398=A0=A0 r8:=A0 0000000000000000
(XEN) r9:=A0 0000000000000000=A0=A0 r10: 0000000000000000=A0=A0 r11: 0000000000000000
(XEN) r12: 0000000000000000=A0=A0 r13: 0000000000000000=A0=A0 r14: 0000000000000000
(XEN) r15: 0000000000000000=A0=A0 cr0: 0000000080000033=A0=A0 cr4: 0000000000002010
(XEN) cr3: 00000000feffc000=A0=A0 cr2: 0000000000000000
(XEN) ds: 9db4=A0=A0 es: 3ec8=A0=A0 fs: 0000=A0=A0 gs: 0000=A0=A0 ss: 9e7c=A0=A0 cs: 9dcc

 --------------080804040609080103070601-- --===============8160884411326514079== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============8160884411326514079==--