Daily Xen-HVM Build Testing: cs10470: broken

Daily Xen-HVM Build Testing: cs10470: broken

[Rick Gonzalez]

Hardware:  x460


- 32bit and 64bit dom0 boots fine.
- 32bit and 64bit hvm guests do not boot at all. the get in a pause state.
- dom0 crashes when I issue the following command "xm destroy <id>"
- no error messages are displayed with "xm dmesg" or "dmesg" on dom0.

I need to hookup a console to get debug information.

Investigation further.



------------------------
Rick Gonzalez
Linux Technology Center
IBM Corporation
Phone#: 512-838-0623

RE: Daily Xen-HVM Build Testing: cs10470: broken

[Nakajima, Jun]

Yes, we are observing the same problem. Our team is saying it would work
if the changeset 10454 "Add support to Xend XML-RPC server for HTTP/1.1
Keep-Alive" is backed out.

Looks like the newly created HVM guest is placed into the pause state.
If we do xm unpause, it starts running.

Jun
---
Intel Open Source Technology Center 

-----Original Message-----
From: xen-devel-bounces@lists.xensource.com
[mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Rick
Gonzalez
Sent: Wednesday, June 21, 2006 9:51 AM
To: Xen Developers
Subject: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken


Hardware:  x460


- 32bit and 64bit dom0 boots fine.
- 32bit and 64bit hvm guests do not boot at all. the get in a pause
state.
- dom0 crashes when I issue the following command "xm destroy <id>"
- no error messages are displayed with "xm dmesg" or "dmesg" on dom0.

I need to hookup a console to get debug information.

Investigation further.



------------------------
Rick Gonzalez
Linux Technology Center
IBM Corporation
Phone#: 512-838-0623


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

Re: Daily Xen-HVM Build Testing: cs10470: broken

[Anthony Liguori]

Does xm create return?

Can you liberally sprinkle xen/xm/create.py:make_domain() with print's 
to figure out where the exception is being generated?

I've seen the RPC's for HVM domain creation exhibit strange behavior 
with not closing the connection (for HTTP/1.0).  I believe this is due 
to a bug somewhere in the HVM create path (probably when it spawns off 
qemu-dm -- not properly daemonizing it).

Regards,

Anthony Liguori

Nakajima, Jun wrote:
> Yes, we are observing the same problem. Our team is saying it would work
> if the changeset 10454 "Add support to Xend XML-RPC server for HTTP/1.1
> Keep-Alive" is backed out.
>
> Looks like the newly created HVM guest is placed into the pause state.
> If we do xm unpause, it starts running.
>
> Jun
> ---
> Intel Open Source Technology Center 
>
> -----Original Message-----
> From: xen-devel-bounces@lists.xensource.com
> [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Rick
> Gonzalez
> Sent: Wednesday, June 21, 2006 9:51 AM
> To: Xen Developers
> Subject: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken
>
>
> Hardware:  x460
>
>
> - 32bit and 64bit dom0 boots fine.
> - 32bit and 64bit hvm guests do not boot at all. the get in a pause
> state.
> - dom0 crashes when I issue the following command "xm destroy <id>"
> - no error messages are displayed with "xm dmesg" or "dmesg" on dom0.
>
> I need to hookup a console to get debug information.
>
> Investigation further.
>
>
>
> ------------------------
> Rick Gonzalez
> Linux Technology Center
> IBM Corporation
> Phone#: 512-838-0623
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
>   

Re: Daily Xen-HVM Build Testing: cs10470: broken

[Anthony Liguori]

[-- Attachment #1: Type: text/plain, Size: 1446 bytes --]

Can ya'll try out the following patch?  It seems to solve the problem 
for me.

Have not run it through xm-test yet though.

Regards,

Anthony Liguori

Nakajima, Jun wrote:
> Yes, we are observing the same problem. Our team is saying it would work
> if the changeset 10454 "Add support to Xend XML-RPC server for HTTP/1.1
> Keep-Alive" is backed out.
>
> Looks like the newly created HVM guest is placed into the pause state.
> If we do xm unpause, it starts running.
>
> Jun
> ---
> Intel Open Source Technology Center 
>
> -----Original Message-----
> From: xen-devel-bounces@lists.xensource.com
> [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Rick
> Gonzalez
> Sent: Wednesday, June 21, 2006 9:51 AM
> To: Xen Developers
> Subject: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken
>
>
> Hardware:  x460
>
>
> - 32bit and 64bit dom0 boots fine.
> - 32bit and 64bit hvm guests do not boot at all. the get in a pause
> state.
> - dom0 crashes when I issue the following command "xm destroy <id>"
> - no error messages are displayed with "xm dmesg" or "dmesg" on dom0.
>
> I need to hookup a console to get debug information.
>
> Investigation further.
>
>
>
> ------------------------
> Rick Gonzalez
> Linux Technology Center
> IBM Corporation
> Phone#: 512-838-0623
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
>   


[-- Attachment #2: xend-keep-alive-hvm.diff --]
[-- Type: text/plain, Size: 1435 bytes --]

# HG changeset patch
# User Anthony Liguori <anthony@codemonkey.ws>
# Node ID ddd4d7e3d79e8bf4999c820fdb5e003d31283d5f
# Parent  411a3c01bb40681731ad50fd3b8c5d7972baf36d
Make sure to explicitly close the connection if we're using HTTP/1.0.  This
shouldn't be needed but it appears to be necessary as the Python client
just does a wfile.read() instead of only reading the reported Content-Length.

Signed-off-by: Anthony Liguori <aliguori@us.ibm.com>

diff -r 411a3c01bb40 -r ddd4d7e3d79e tools/python/xen/util/xmlrpclib2.py
--- a/tools/python/xen/util/xmlrpclib2.py	Tue Jun 20 18:51:46 2006 +0100
+++ b/tools/python/xen/util/xmlrpclib2.py	Wed Jun 21 16:47:48 2006 -0500
@@ -58,8 +58,6 @@ class XMLRPCRequestHandler(SimpleXMLRPCR
     #    propagate so that it shows up in the Xend debug logs
     # 2) we don't bother checking for a _dispatch function since we don't
     #    use one
-    # 3) we never shutdown the connection.  This appears to be a bug in
-    #    SimpleXMLRPCServer.py as it breaks HTTP Keep-Alive
     def do_POST(self):
         data = self.rfile.read(int(self.headers["content-length"]))
         rsp = self.server._marshaled_dispatch(data)
@@ -71,6 +69,8 @@ class XMLRPCRequestHandler(SimpleXMLRPCR
 
         self.wfile.write(rsp)
         self.wfile.flush()
+        if self.close_connection == 1:
+            self.connection.shutdown(1)
 
 class HTTPUnixConnection(HTTPConnection):
     def connect(self):

[-- Attachment #3: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

RE: Daily Xen-HVM Build Testing: cs10470: broken

[Xin, Xiaohui]

Yes, your patch works! I have tested it, the PAE guest and 32bit guest can be created now against CS 10470.:-) 

Thanks
Xiaohui

-----Original Message-----
From: xen-devel-bounces@lists.xensource.com [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Anthony Liguori
Sent: 2006年6月22日 5:49
To: Nakajima, Jun
Cc: Xen Developers; Rick Gonzalez
Subject: Re: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken

Can ya'll try out the following patch?  It seems to solve the problem 
for me.

Have not run it through xm-test yet though.

Regards,

Anthony Liguori

Nakajima, Jun wrote:
> Yes, we are observing the same problem. Our team is saying it would work
> if the changeset 10454 "Add support to Xend XML-RPC server for HTTP/1.1
> Keep-Alive" is backed out.
>
> Looks like the newly created HVM guest is placed into the pause state.
> If we do xm unpause, it starts running.
>
> Jun
> ---
> Intel Open Source Technology Center 
>
> -----Original Message-----
> From: xen-devel-bounces@lists.xensource.com
> [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Rick
> Gonzalez
> Sent: Wednesday, June 21, 2006 9:51 AM
> To: Xen Developers
> Subject: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken
>
>
> Hardware:  x460
>
>
> - 32bit and 64bit dom0 boots fine.
> - 32bit and 64bit hvm guests do not boot at all. the get in a pause
> state.
> - dom0 crashes when I issue the following command "xm destroy <id>"
> - no error messages are displayed with "xm dmesg" or "dmesg" on dom0.
>
> I need to hookup a console to get debug information.
>
> Investigation further.
>
>
>
> ------------------------
> Rick Gonzalez
> Linux Technology Center
> IBM Corporation
> Phone#: 512-838-0623
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
>   

Re: Daily Xen-HVM Build Testing: cs10470: broken

[Anthony Liguori]

Xin, Xiaohui wrote:
> Yes, your patch works! I have tested it, the PAE guest and 32bit guest can be created now against CS 10470.:-) 
>   

I'm pretty sure this is the correct fix. This uncovered another bug
though that I'll let someone else hunt down. Xen appears to die quite
quickly if you attempt to do an xm destroy on a paused domain (or
perhaps on a domain that has never been started).

I'll submit as a [PATCH] tomorrow unless anyone finds additional problems.

Regards,

Anthony Liguori

> Thanks
> Xiaohui
>
> -----Original Message-----
> From: xen-devel-bounces@lists.xensource.com [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Anthony Liguori
> Sent: 2006年6月22日 5:49
> To: Nakajima, Jun
> Cc: Xen Developers; Rick Gonzalez
> Subject: Re: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken
>
> Can ya'll try out the following patch?  It seems to solve the problem 
> for me.
>
> Have not run it through xm-test yet though.
>
> Regards,
>
> Anthony Liguori
>
> Nakajima, Jun wrote:
>   
>> Yes, we are observing the same problem. Our team is saying it would work
>> if the changeset 10454 "Add support to Xend XML-RPC server for HTTP/1.1
>> Keep-Alive" is backed out.
>>
>> Looks like the newly created HVM guest is placed into the pause state.
>> If we do xm unpause, it starts running.
>>
>> Jun
>> ---
>> Intel Open Source Technology Center 
>>
>> -----Original Message-----
>> From: xen-devel-bounces@lists.xensource.com
>> [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Rick
>> Gonzalez
>> Sent: Wednesday, June 21, 2006 9:51 AM
>> To: Xen Developers
>> Subject: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken
>>
>>
>> Hardware:  x460
>>
>>
>> - 32bit and 64bit dom0 boots fine.
>> - 32bit and 64bit hvm guests do not boot at all. the get in a pause
>> state.
>> - dom0 crashes when I issue the following command "xm destroy <id>"
>> - no error messages are displayed with "xm dmesg" or "dmesg" on dom0.
>>
>> I need to hookup a console to get debug information.
>>
>> Investigation further.
>>
>>
>>
>> ------------------------
>> Rick Gonzalez
>> Linux Technology Center
>> IBM Corporation
>> Phone#: 512-838-0623
>>
>>
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@lists.xensource.com
>> http://lists.xensource.com/xen-devel
>>   
>>     

Re: Daily Xen-HVM Build Testing: cs10470: broken

[Rick Gonzalez]

[-- Attachment #1: Type: text/plain, Size: 2989 bytes --]

Anthony Liguori wrote:
> Xin, Xiaohui wrote:
>   
>> Yes, your patch works! I have tested it, the PAE guest and 32bit guest can be created now against CS 10470.:-) 
>>   
>>     
>
> I'm pretty sure this is the correct fix. This uncovered another bug
> though that I'll let someone else hunt down. Xen appears to die quite
> quickly if you attempt to do an xm destroy on a paused domain (or
> perhaps on a domain that has never been started).
>
> I'll submit as a [PATCH] tomorrow unless anyone finds additional problems.
>   
Anthony,

It works fine for me too so far. Please do submit the patch as soon as
you can. :)


regards,

rick
> Regards,
>
> Anthony Liguori
>
>   
>> Thanks
>> Xiaohui
>>
>> -----Original Message-----
>> From: xen-devel-bounces@lists.xensource.com [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Anthony Liguori
>> Sent: 2006年6月22日 5:49
>> To: Nakajima, Jun
>> Cc: Xen Developers; Rick Gonzalez
>> Subject: Re: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken
>>
>> Can ya'll try out the following patch?  It seems to solve the problem 
>> for me.
>>
>> Have not run it through xm-test yet though.
>>
>> Regards,
>>
>> Anthony Liguori
>>
>> Nakajima, Jun wrote:
>>   
>>     
>>> Yes, we are observing the same problem. Our team is saying it would work
>>> if the changeset 10454 "Add support to Xend XML-RPC server for HTTP/1.1
>>> Keep-Alive" is backed out.
>>>
>>> Looks like the newly created HVM guest is placed into the pause state.
>>> If we do xm unpause, it starts running.
>>>
>>> Jun
>>> ---
>>> Intel Open Source Technology Center 
>>>
>>> -----Original Message-----
>>> From: xen-devel-bounces@lists.xensource.com
>>> [mailto:xen-devel-bounces@lists.xensource.com] On Behalf Of Rick
>>> Gonzalez
>>> Sent: Wednesday, June 21, 2006 9:51 AM
>>> To: Xen Developers
>>> Subject: [Xen-devel] Daily Xen-HVM Build Testing: cs10470: broken
>>>
>>>
>>> Hardware:  x460
>>>
>>>
>>> - 32bit and 64bit dom0 boots fine.
>>> - 32bit and 64bit hvm guests do not boot at all. the get in a pause
>>> state.
>>> - dom0 crashes when I issue the following command "xm destroy <id>"
>>> - no error messages are displayed with "xm dmesg" or "dmesg" on dom0.
>>>
>>> I need to hookup a console to get debug information.
>>>
>>> Investigation further.
>>>
>>>
>>>
>>> ------------------------
>>> Rick Gonzalez
>>> Linux Technology Center
>>> IBM Corporation
>>> Phone#: 512-838-0623
>>>
>>>
>>> _______________________________________________
>>> Xen-devel mailing list
>>> Xen-devel@lists.xensource.com
>>> http://lists.xensource.com/xen-devel
>>>   
>>>     
>>>       
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
>
>   


-- 
--------------------
Rick Gonzalez
Linux Technology Center
IBM Corporation
Phone#: 512-838-0623


[-- Attachment #2: rcgneo.vcf --]
[-- Type: text/x-vcard, Size: 268 bytes --]

begin:vcard
fn:Rick Gonzalez
n:Gonzalez;Rick
org:;LTC Test Development
adr:;;11501 Burnet Rd;Austin;TX;78758;USA
email;internet:rcgneo@us.ibm.com
title:Staff Engineer
tel;work:512-838-0623
tel;fax:512-838-8858
tel;home:512-873-2286
version:2.1
end:vcard


[-- Attachment #3: Type: text/plain, Size: 138 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel