From mboxrd@z Thu Jan 1 00:00:00 1970 From: mailing lists Subject: Nested Virt - Xen 4.4 through 4.6 - Hyper-V; Can't boot after enabling Hyper-V Date: Mon, 6 Apr 2015 21:42:30 -0400 Message-ID: Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2178094187273225366==" Return-path: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: xen-devel@lists.xen.org List-Id: xen-devel@lists.xenproject.org --===============2178094187273225366== Content-Type: multipart/alternative; boundary=001a1134abe8242bd5051318870c --001a1134abe8242bd5051318870c Content-Type: text/plain; charset=UTF-8 Hi -- I've been trying to get nested virtualization working with Xen so that I could boot Windows and use Hyper-V related features, however I have not had much success. Using Windows 8.1 or Windows 2012r2, I'm able to install Windows, select and install Hyper-V features, and start rebooting. However, at that point, the Windows VM only partially boots, then drops me to a screen stating: Your PC needs to restart. Please hold down the power button. Error Code: 0x0000001E Parameters: 0xFFFFFFFFC0000096 0xFFFFF80315430485 0x0000000000000000 0x0000000000000000 Restarting does not yield any different results. I've set up Xen in accordance with the notes for patches and config options here: http://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen Trying Xen 4.4.2 stable, 4.5.1 staging, and 4.6 staging. I applied the patch labeled (2/2) from the wiki link above, compiled, and used the three options provided for the DomU running Windows (hap, nestedhvm, and cpuid mask). Windows installs and allows me to turn on HyperV features on all versions of Xen listed above, however all give the same or similar message on reboot... I'm never able to get to a running state. I've tried this on two separate systems. One has an Intel E5-1620 v2, and the other is a n E5-1650 (original, v1 I guess). All the virtualization options are enabled in the BIOS. If the cpuid mask is removed from the DomU config, Windows boots, however I'm unable to start any virtual machines (there was a message in the Windows event log about a component not being started in regards to Hyper V). Has anyone else run into similar issues? Any thoughts on next steps? --001a1134abe8242bd5051318870c Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi --

I've been trying to get neste= d virtualization working with Xen so that I could boot Windows and use Hype= r-V related features, however I have not had much success.=C2=A0 Using Wind= ows 8.1 or Windows 2012r2, I'm able to install Windows, select and inst= all Hyper-V features, and start rebooting.=C2=A0 However, at that point, th= e Windows VM only partially boots, then drops me to a screen stating:
=

Your PC needs to restart.
Please hold down th= e power button.
Error Code: 0x0000001E
Parameters:
0xFFFFFFFFC0000096
0xFFFFF80315430485
0x000000000= 0000000
0x0000000000000000


Restarting does not yield any different results.

I've set up Xen in accordance with the notes for patches and config op= tions here:


Trying Xen 4.4.2 stab= le, 4.5.1 staging, and 4.6 staging.=C2=A0 I applied the patch labeled (2/2)= from the wiki link above, compiled, and used the three options provided fo= r the DomU running Windows (hap, nestedhvm, and cpuid mask).=C2=A0 Windows = installs and allows me to turn on HyperV features on all versions of Xen li= sted above, however all give the same or similar message on reboot... I'= ;m never able to get to a running state.

I've = tried this on two separate systems.=C2=A0 One has an Intel E5-1620 v2, and = the other is a n E5-1650 (original, v1 I guess).=C2=A0 All the virtualizati= on options are enabled in the BIOS.

If the cpuid m= ask is removed from the DomU config, Windows boots, however I'm unable = to start any virtual machines (there was a message in the Windows event log= about a component not being started in regards to Hyper V).

=
Has anyone else run into similar issues?=C2=A0 Any thoughts on n= ext steps?


--001a1134abe8242bd5051318870c-- --===============2178094187273225366== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============2178094187273225366==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: George Dunlap Subject: Re: Nested Virt - Xen 4.4 through 4.6 - Hyper-V; Can't boot after enabling Hyper-V Date: Tue, 7 Apr 2015 12:29:59 +0100 Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: In-Reply-To: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: mailing lists Cc: Li Liang Z , "xen-devel@lists.xen.org" List-Id: xen-devel@lists.xenproject.org On Tue, Apr 7, 2015 at 2:42 AM, mailing lists wrote: > Hi -- > > I've been trying to get nested virtualization working with Xen so that I > could boot Windows and use Hyper-V related features, however I have not had > much success. Using Windows 8.1 or Windows 2012r2, I'm able to install > Windows, select and install Hyper-V features, and start rebooting. However, > at that point, the Windows VM only partially boots, then drops me to a > screen stating: > > Your PC needs to restart. > Please hold down the power button. > Error Code: 0x0000001E > Parameters: > 0xFFFFFFFFC0000096 > 0xFFFFF80315430485 > 0x0000000000000000 > 0x0000000000000000 > > > Restarting does not yield any different results. > > I've set up Xen in accordance with the notes for patches and config options > here: > > http://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen > > Trying Xen 4.4.2 stable, 4.5.1 staging, and 4.6 staging. I applied the > patch labeled (2/2) from the wiki link above, compiled, and used the three > options provided for the DomU running Windows (hap, nestedhvm, and cpuid > mask). Windows installs and allows me to turn on HyperV features on all > versions of Xen listed above, however all give the same or similar message > on reboot... I'm never able to get to a running state. > > I've tried this on two separate systems. One has an Intel E5-1620 v2, and > the other is a n E5-1650 (original, v1 I guess). All the virtualization > options are enabled in the BIOS. > > If the cpuid mask is removed from the DomU config, Windows boots, however > I'm unable to start any virtual machines (there was a message in the Windows > event log about a component not being started in regards to Hyper V). > > Has anyone else run into similar issues? Any thoughts on next steps? CC'ing Liang Z to see if he has any ideas. Liang, I'm pretty sure you guys are testing HyperV internally, right? -George From mboxrd@z Thu Jan 1 00:00:00 1970 From: Andrew Cooper Subject: Re: Nested Virt - Xen 4.4 through 4.6 - Hyper-V; Can't boot after enabling Hyper-V Date: Tue, 7 Apr 2015 17:19:49 +0100 Message-ID: <552403A5.80908@citrix.com> References: Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============8690527983444307635==" Return-path: In-Reply-To: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: mailing lists , xen-devel@lists.xen.org List-Id: xen-devel@lists.xenproject.org --===============8690527983444307635== Content-Type: multipart/alternative; boundary="------------090602040402030002090109" --------------090602040402030002090109 Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: 7bit On 07/04/15 02:42, mailing lists wrote: > Hi -- > > I've been trying to get nested virtualization working with Xen so that > I could boot Windows and use Hyper-V related features, however I have > not had much success. Using Windows 8.1 or Windows 2012r2, I'm able > to install Windows, select and install Hyper-V features, and start > rebooting. However, at that point, the Windows VM only partially > boots, then drops me to a screen stating: > > Your PC needs to restart. > Please hold down the power button. > Error Code: 0x0000001E > Parameters: > 0xFFFFFFFFC0000096 > 0xFFFFF80315430485 > 0x0000000000000000 > 0x0000000000000000 > > > Restarting does not yield any different results. > > I've set up Xen in accordance with the notes for patches and config > options here: > > http://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen > > Trying Xen 4.4.2 stable, 4.5.1 staging, and 4.6 staging. I applied > the patch labeled (2/2) from the wiki link above, compiled, and used > the three options provided for the DomU running Windows (hap, > nestedhvm, and cpuid mask). Windows installs and allows me to turn on > HyperV features on all versions of Xen listed above, however all give > the same or similar message on reboot... I'm never able to get to a > running state. > > I've tried this on two separate systems. One has an Intel E5-1620 v2, > and the other is a n E5-1650 (original, v1 I guess). All the > virtualization options are enabled in the BIOS. > > If the cpuid mask is removed from the DomU config, Windows boots, > however I'm unable to start any virtual machines (there was a message > in the Windows event log about a component not being started in > regards to Hyper V). > > Has anyone else run into similar issues? Any thoughts on next steps? I am not aware of anyone who has successfully got a setup like this to work. From https://msdn.microsoft.com/en-us/library/windows/hardware/ff557408%28v=vs.85%29.aspx 0x1E is KMODE_EXCEPTION_NOT_HANDLED. http://source.winehq.org/source/include/ntstatus.h suggests that 0xFFFFFFFFC0000096 is STATUS_PRIVILEGED_INSTRUCTION. Your best bet for debugging this is to debug the minidump generated and see which driver 0xFFFFF80315430485 is a part of, and perhaps exactly what instruction 0xFFFFF80315430485 actually is. ~Andrew --------------090602040402030002090109 Content-Type: text/html; charset="windows-1252" Content-Length: 4149 Content-Transfer-Encoding: quoted-printable
On 07/04/15 02:42, mailing lists wrote:
Hi --

I've been trying to get nested virtualization working with Xen so that I could boot Windows and use Hyper-V related features, however I have not had much success.=A0 Using Windows 8.1 or Windows 2012r2, I'm able to install Windows, select and install Hyper-V features, and start rebooting.=A0 However, at that point, the Windows VM only partially boots, then drops me to a screen stating:

Your PC needs to restart.
Please hold down the power button.
Error Code: 0x0000001E
Parameters:
0xFFFFFFFFC0000096
0xFFFFF80315430485
0x0000000000000000
0x0000000000000000


Restarting does not yield any different results.

I've set up Xen in accordance with the notes for patches and config options here:


Trying Xen 4.4.2 stable, 4.5.1 staging, and 4.6 staging.=A0 I applied the patch labeled (2/2) from the wiki link above, compiled, and used the three options provided for the DomU running Windows (hap, nestedhvm, and cpuid mask).=A0 Windows installs and allows me to turn on HyperV features on all versions of Xen listed above, however all give the same or similar message on reboot... I'm never able to get to a running state.

I've tried this on two separate systems.=A0 One has an Intel E5-1620 v2, and the other is a n E5-1650 (original, v1 I guess).=A0 All the virtualization options are enabled in the BIOS.

If the cpuid mask is removed from the DomU config, Windows boots, however I'm unable to start any virtual machines (there was a message in the Windows event log about a component not being started in regards to Hyper V).

Has anyone else run into similar issues=3F=A0 Any thoughts on next steps=3F

I am not aware of anyone who has successfully got a setup like this to work.

From https://msdn.microsoft.com/en-us/library/windows/hardware/ff557408%28v=3Dvs.85%29.aspx

0x1E is KMODE_EXCEPTION_NOT_HANDLED.

http://source.winehq.org/source/include/ntstatus.h suggests that 0xFFFFFFFFC0000096 is STATUS_PRIVILEGED_INSTRUCTION.

Your best bet for debugging this is to debug the minidump generated and see which driver 0xFFFFF80315430485 is a part of, and perhaps exactly what instruction 0xFFFFF80315430485 actually is.

~Andrew
--------------090602040402030002090109-- --===============8690527983444307635== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============8690527983444307635==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: mailing lists Subject: Re: Nested Virt - Xen 4.4 through 4.6 - Hyper-V; Can't boot after enabling Hyper-V Date: Tue, 7 Apr 2015 16:12:04 -0400 Message-ID: References: <552403A5.80908@citrix.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============2658686485609001654==" Return-path: In-Reply-To: <552403A5.80908@citrix.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Andrew Cooper Cc: xen-devel@lists.xen.org List-Id: xen-devel@lists.xenproject.org --===============2658686485609001654== Content-Type: multipart/alternative; boundary=001a11c172123b20fe05132807f6 --001a11c172123b20fe05132807f6 Content-Type: text/plain; charset=UTF-8 Which portion of "this" is the unicorn? Nested virtualization of Hyper-V under Xen? Or something else about my setup? I did try to go down the path of evaluating a memory dump, however while minidumps are enabled, they do not seem to be getting created on either of my test systems when the message about needing to reboot is presented. -- Bill On Tue, Apr 7, 2015 at 12:19 PM, Andrew Cooper wrote: > On 07/04/15 02:42, mailing lists wrote: > > Hi -- > > I've been trying to get nested virtualization working with Xen so that I > could boot Windows and use Hyper-V related features, however I have not had > much success. Using Windows 8.1 or Windows 2012r2, I'm able to install > Windows, select and install Hyper-V features, and start rebooting. > However, at that point, the Windows VM only partially boots, then drops me > to a screen stating: > > Your PC needs to restart. > Please hold down the power button. > Error Code: 0x0000001E > Parameters: > 0xFFFFFFFFC0000096 > 0xFFFFF80315430485 > 0x0000000000000000 > 0x0000000000000000 > > > Restarting does not yield any different results. > > I've set up Xen in accordance with the notes for patches and config > options here: > > http://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen > > Trying Xen 4.4.2 stable, 4.5.1 staging, and 4.6 staging. I applied the > patch labeled (2/2) from the wiki link above, compiled, and used the three > options provided for the DomU running Windows (hap, nestedhvm, and cpuid > mask). Windows installs and allows me to turn on HyperV features on all > versions of Xen listed above, however all give the same or similar message > on reboot... I'm never able to get to a running state. > > I've tried this on two separate systems. One has an Intel E5-1620 v2, > and the other is a n E5-1650 (original, v1 I guess). All the > virtualization options are enabled in the BIOS. > > If the cpuid mask is removed from the DomU config, Windows boots, > however I'm unable to start any virtual machines (there was a message in > the Windows event log about a component not being started in regards to > Hyper V). > > Has anyone else run into similar issues? Any thoughts on next steps? > > > I am not aware of anyone who has successfully got a setup like this to > work. > > From > https://msdn.microsoft.com/en-us/library/windows/hardware/ff557408%28v=vs.85%29.aspx > > 0x1E is KMODE_EXCEPTION_NOT_HANDLED. > > http://source.winehq.org/source/include/ntstatus.h suggests that > 0xFFFFFFFFC0000096 is STATUS_PRIVILEGED_INSTRUCTION. > > Your best bet for debugging this is to debug the minidump generated and > see which driver 0xFFFFF80315430485 is a part of, and perhaps exactly what > instruction 0xFFFFF80315430485 actually is. > > ~Andrew > --001a11c172123b20fe05132807f6 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Which portion of "this" is the unicorn?=C2=A0 Ne= sted virtualization of Hyper-V under Xen?=C2=A0 Or something else about my = setup?

I did try to go down the path of evaluating a mem= ory dump, however while minidumps are enabled, they do not seem to be getti= ng created on either of my test systems when the message about needing to r= eboot is presented.

-- Bill

On Tue, Apr 7, 2015 at 12:1= 9 PM, Andrew Cooper <andrew.cooper3@citrix.com> wrot= e:
=20 =20 =20
On 07/04/15 02:42, mailing lists wrote:
=20
Hi --

I've been trying to get nested virtualization working with Xen so that I could boot Windows and use Hyper-V related features, however I have not had much success.=C2=A0 Using Window= s 8.1 or Windows 2012r2, I'm able to install Windows, select an= d install Hyper-V features, and start rebooting.=C2=A0 However, at that point, the Windows VM only partially boots, then drops me to a screen stating:

Your PC needs to restart.
Please hold down the power button.
Error Code: 0x0000001E
Parameters:
0xFFFFFFFFC0000096
0xFFFFF80315430485
0x0000000000000000
0x0000000000000000


Restarting does not yield any different results.

I've set up Xen in accordance with the notes for patches and config options here:


Trying Xen 4.4.2 stable, 4.5.1 staging, and 4.6 staging.=C2=A0= I applied the patch labeled (2/2) from the wiki link above, compiled, and used the three options provided for the DomU running Windows (hap, nestedhvm, and cpuid mask).=C2=A0 Windows installs and allows me to turn on HyperV features on all versions of Xen listed above, however all give the same or similar message on reboot... I'm never able to get to a running state.

I've tried this on two separate systems.=C2=A0 One has an = Intel E5-1620 v2, and the other is a n E5-1650 (original, v1 I guess).=C2=A0 All the virtualization options are enabled in the BIOS.

If the cpuid mask is removed from the DomU config, Windows boots, however I'm unable to start any virtual machines (ther= e was a message in the Windows event log about a component not being started in regards to Hyper V).

Has anyone else run into similar issues?=C2=A0 Any thoughts on next steps?

I am not aware of anyone who has successfully got a setup like this to work.

From https://msdn.microsoft.com/en-us/= library/windows/hardware/ff557408%28v=3Dvs.85%29.aspx

0x1E is KMODE_EXCEPTION_NOT_HANDLED.

http://source.winehq.org/source/include/ntstatus.h suggests= that 0xFFFFFFFFC0000096 is STATUS_PRIVILEGED_INSTRUCTION.

Your best bet for debugging this is to debug the minidump generated and see which driver 0xFFFFF80315430485 is a part of, and perhaps exactly what instruction 0xFFFFF80315430485 actually is.

~Andrew

--001a11c172123b20fe05132807f6-- --===============2658686485609001654== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============2658686485609001654==-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Li, Liang Z" Subject: Re: Nested Virt - Xen 4.4 through 4.6 - Hyper-V; Can't boot after enabling Hyper-V Date: Wed, 8 Apr 2015 15:22:10 +0000 Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: In-Reply-To: Content-Language: en-US List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: George Dunlap , mailing lists Cc: "Zhang, Yang Z" , "xen-devel@lists.xen.org" List-Id: xen-devel@lists.xenproject.org > On Tue, Apr 7, 2015 at 2:42 AM, mailing lists wrote: > > Hi -- > > > > I've been trying to get nested virtualization working with Xen so that > > I could boot Windows and use Hyper-V related features, however I have > > not had much success. Using Windows 8.1 or Windows 2012r2, I'm able > > to install Windows, select and install Hyper-V features, and start > > rebooting. However, at that point, the Windows VM only partially > > boots, then drops me to a screen stating: > > > > Your PC needs to restart. > > Please hold down the power button. > > Error Code: 0x0000001E > > Parameters: > > 0xFFFFFFFFC0000096 > > 0xFFFFF80315430485 > > 0x0000000000000000 > > 0x0000000000000000 > > > > > > Restarting does not yield any different results. > > > > I've set up Xen in accordance with the notes for patches and config > > options > > here: > > > > http://wiki.xenproject.org/wiki/Nested_Virtualization_in_Xen > > > > Trying Xen 4.4.2 stable, 4.5.1 staging, and 4.6 staging. I applied > > the patch labeled (2/2) from the wiki link above, compiled, and used > > the three options provided for the DomU running Windows (hap, > > nestedhvm, and cpuid mask). Windows installs and allows me to turn on > > HyperV features on all versions of Xen listed above, however all give > > the same or similar message on reboot... I'm never able to get to a running > state. > > > > I've tried this on two separate systems. One has an Intel E5-1620 v2, > > and the other is a n E5-1650 (original, v1 I guess). All the > > virtualization options are enabled in the BIOS. > > > > If the cpuid mask is removed from the DomU config, Windows boots, > > however I'm unable to start any virtual machines (there was a message > > in the Windows event log about a component not being started in regards > to Hyper V). > > > > Has anyone else run into similar issues? Any thoughts on next steps? > > > CC'ing Liang Z to see if he has any ideas. > > Liang, I'm pretty sure you guys are testing HyperV internally, right? + Yang Z. Sorry, I know little about that. May be Yang can give you some help. Liang > > -George