Re: Daily Xen Builds

[David F Barrera <dfbp@us.ibm.com>]

Harry Butterworth wrote:
> In your create_concurrent_pos failures is qemu_dm maxing out the cpu in
> dom0?
>
> On Mon, 2006-08-07 at 11:04 -0500, David F Barrera wrote:
>   
>> August 7, 2006, using xen-unstable changeset:
>>
>> changeset:   10949:ffa5b2975dff
>> tag:         tip
>> user:        kfraser@localhost.localdomain
>> date:        Fri Aug  4 14:34:44 2006 +0100
>> summary:     [XEN] Add Xen-attached event channels, which will be used
>>
>> ISSUES:
>> * Bugzilla Bug 714 xm-test failures - hping tests failing (all distros/hw)
>> * Bugzilla Bug 715 xm-test failure - FAIL: 01_migrate_localhost_pos (fails on RHEL4 and FC6)
>>
>> x86_32 (no PAE support)
>>
>> * SLES 9 SP2 on IBM xSeries 335, and 235
>> * Builds and boots without problems
>> * Able to create fully functional guest domains
>> * Ran xm-test on all boxes
>>
>> x86_32 (PAE)
>>
>> * FC4 on x335 and RHEL 4 on HS20 Blade 8843
>> * Builds and boots without problems
>> * Able to create fully functional guest domains
>>
>> ISSUES:
>>
>> x86_64 (SLES 9, SLES 10, and FC6 on IBM HS20 Blades 8843 41U)
>>
>> * Builds and boots without problems
>> * Able to create fully functional guest domains
>> * Ran xm-test on all boxes
>>
>> ISSUES:
>>
>> XM-TEST results summary: 
>>
>>             Platform | PASS | FAIL | XPASS | XFAIL |
>> ---------------------+------+------+-------+-------+
>>      hs20.FC6-x86_64 |  105 |    4 |     0 |     3 |
>>       hs20.rhel4-PAE |  101 |    9 |     0 |     3 |
>>   hs20.sles10-x86_64 |  105 |    6 |     0 |     3 |
>>    hs20.sles9-x86_64 |  105 |    6 |     0 |     3 |
>>           x235-sles9 |  105 |    4 |     0 |     3 |
>>          x335fc4-PAE |  104 |    7 |     0 |     3 |
>>            x335sles9 |  107 |    4 |     0 |     3 |
>>
>>
>> plain text document attachment (hs20.FC6-x86_64.report)
>> Xm-test execution summary:
>>   PASS:  105
>>   FAIL:  4
>>   XPASS: 0
>>   XFAIL: 3
>>
>>
>> Details:
>>
>>  FAIL: 02_info_compiledata_pos 
>> 	Unknown reason
>>
>> XFAIL: 02_network_local_ping_pos 
>> 	 ping loopback failed for size 65507. ping eth0 failed for size 65507.
>>
>> XFAIL: 05_network_dom0_ping_pos 
>> 	 Ping to dom0 failed for size 65507.
>>
>> XFAIL: 11_network_domU_ping_pos 
>> 	 Ping failed for size 65507.
>>
>> plain text document attachment (hs20.rhel4-PAE.report)
>> Xm-test execution summary:
>>   PASS:  101
>>   FAIL:  9
>>   XPASS: 0
>>   XFAIL: 3
>>
>>
>> Details:
>>
>>  FAIL: 11_create_concurrent_pos 
>> 	Unknown reason
>>
>>  FAIL: 01_migrate_localhost_pos 
>> 	 xm migrate returned invalid 256 != 0
>>
>> XFAIL: 02_network_local_ping_pos 
>> 	 ping loopback failed for size 65507. ping eth0 failed for size 65507.
>>
>> XFAIL: 05_network_dom0_ping_pos 
>> 	 Ping to dom0 failed for size 512 1440 1500 1505 4096 65507.
>>
>>  FAIL: 06_network_dom0_tcp_pos 
>> 	 TCP hping2 to dom0 failed for size 1440 1500 1505.
>>
>>  FAIL: 07_network_dom0_udp_pos 
>> 	 UDP hping2 to dom0 failed for size 4096 4192.
>>
>> XFAIL: 11_network_domU_ping_pos 
>> 	 Ping failed for size 32767 65507.
>>
>>  FAIL: 12_network_domU_tcp_pos 
>> 	 TCP hping2 failed for size 512 1440 1500 1505 4096 4192.
>>
>>  FAIL: 13_network_domU_udp_pos 
>> 	 UDP hping2 failed for size 1500 1505 4096 32767 65495.
>>
>> plain text document attachment (hs20.sles9-x86_64.report)
>> Xm-test execution summary:
>>   PASS:  105
>>   FAIL:  6
>>   XPASS: 0
>>   XFAIL: 3
>>
>>
>> Details:
>>
>>  FAIL: 02_info_compiledata_pos 
>> 	Unknown reason
>>
>> XFAIL: 02_network_local_ping_pos 
>> 	 ping loopback failed for size 65507. ping eth0 failed for size 65507.
>>
>> XFAIL: 05_network_dom0_ping_pos 
>> 	 Ping to dom0 failed for size 65507.
>>
>> XFAIL: 11_network_domU_ping_pos 
>> 	 Ping failed for size 1505 4096 4192 32767 65507.
>>
>>  FAIL: 12_network_domU_tcp_pos 
>> 	 TCP hping2 failed for size 1505.
>>
>>  FAIL: 13_network_domU_udp_pos 
>> 	 UDP hping2 failed for size 1505 4096 32767 65495.
>>
>> plain text document attachment (hs20.sles10-x86_64.report)
>> Xm-test execution summary:
>>   PASS:  105
>>   FAIL:  6
>>   XPASS: 0
>>   XFAIL: 3
>>
>>
>> Details:
>>
>> XFAIL: 02_network_local_ping_pos 
>> 	 ping loopback failed for size 65507. ping eth0 failed for size 65507.
>>
>> XFAIL: 05_network_dom0_ping_pos 
>> 	 Ping to dom0 failed for size 65507.
>>
>>  FAIL: 07_network_dom0_udp_pos 
>> 	 UDP hping2 to dom0 failed for size 512 1440 1500 1505 4096 4192.
>>
>> XFAIL: 11_network_domU_ping_pos 
>> 	 Ping failed for size 65507.
>>
>>  FAIL: 12_network_domU_tcp_pos 
>> 	 TCP hping2 failed for size 512 1440 1500 1505 4096.
>>
>>  FAIL: 13_network_domU_udp_pos 
>> 	 UDP hping2 failed for size 1505 4096 4192 32767 65495.
>>
>> plain text document attachment (x235-sles9.report)
>> Xm-test execution summary:
>>   PASS:  105
>>   FAIL:  4
>>   XPASS: 0
>>   XFAIL: 3
>>
>>
>> Details:
>>
>>  FAIL: 11_create_concurrent_pos 
>> 	Unknown reason
>>
>> XFAIL: 02_network_local_ping_pos 
>> 	 ping loopback failed for size 65507. ping eth0 failed for size 65507.
>>
>> XFAIL: 05_network_dom0_ping_pos 
>> 	 Ping to dom0 failed for size 65507.
>>
>> XFAIL: 11_network_domU_ping_pos 
>> 	 Ping failed for size 65507.
>>
>> plain text document attachment (x335fc4-PAE.report)
>> Xm-test execution summary:
>>   PASS:  104
>>   FAIL:  7
>>   XPASS: 0
>>   XFAIL: 3
>>
>>
>> Details:
>>
>>  FAIL: 11_create_concurrent_pos 
>> 	Unknown reason
>>
>> XFAIL: 02_network_local_ping_pos 
>> 	 ping loopback failed for size 65507. ping eth0 failed for size 65507.
>>
>> XFAIL: 05_network_dom0_ping_pos 
>> 	 Ping to dom0 failed for size 65507.
>>
>>  FAIL: 06_network_dom0_tcp_pos 
>> 	 TCP hping2 to dom0 failed for size 512 1440 1500 1505 4096 4192.
>>
>>  FAIL: 07_network_dom0_udp_pos 
>> 	 UDP hping2 to dom0 failed for size 512 1440 1500.
>>
>> XFAIL: 11_network_domU_ping_pos 
>> 	 Ping failed for size 4192 32767 65507.
>>
>>  FAIL: 12_network_domU_tcp_pos 
>> 	 TCP hping2 failed for size 1500 1505 4096 4192.
>>
>> plain text document attachment (x335sles9.report)
>> Xm-test execution summary:
>>   PASS:  107
>>   FAIL:  4
>>   XPASS: 0
>>   XFAIL: 3
>>
>>
>> Details:
>>
>>  FAIL: 11_create_concurrent_pos 
>> 	Unknown reason
>>
>> XFAIL: 02_network_local_ping_pos 
>> 	 ping loopback failed for size 65507. ping eth0 failed for size 65507.
>>
>> XFAIL: 05_network_dom0_ping_pos 
>> 	 Ping to dom0 failed for size 65507.
>>
>> XFAIL: 11_network_domU_ping_pos 
>> 	 Ping failed for size 65507.
>>
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@lists.xensource.com
>> http://lists.xensource.com/xen-devel
>>     
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
>   
Harry,

The console is spewing all these messages:

Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
Out of Memory: Kill process 2 (migration/0) score 0 and children.
...

Eventually, the test errors out:

Started domain 11_create_0
Console executing: ['/usr/sbin/xm', 'xm', 'console', '11_create_0']
Traceback (most recent call last):
  File "./11_create_concurrent_pos.test", line 46, in ?
    cons = dom.start()
  File 
"/usr/local/autobench/var/tmp/xen/xen-unstable.hg/tools/xm-test/lib/XmTestLib/XenDomain.py", 
line 233, in start
    return self.getConsole()
  File 
"/usr/local/autobench/var/tmp/xen/xen-unstable.hg/tools/xm-test/lib/XmTestLib/XenDomain.py", 
line 284, in getConsole
    self.console.sendInput("input")
  File 
"/usr/local/autobench/var/tmp/xen/xen-unstable.hg/tools/xm-test/lib/XmTestLib/Console.py", 
line 241, in sendInput
    realOutput = self.__runCmd(input)
  File 
"/usr/local/autobench/var/tmp/xen/xen-unstable.hg/tools/xm-test/lib/XmTestLib/Console.py", 
line 168, in __runCmd
    self.__getprompt(self.consoleFd)
  File 
"/usr/local/autobench/var/tmp/xen/xen-unstable.hg/tools/xm-test/lib/XmTestLib/Console.py", 
line 139, in __getprompt
    % self.limit, RUNAWAY)
XmTestLib.Console.ConsoleError: Console run-away (exceeded 131072 bytes)
FAIL: 11_create_concurrent_pos.test

-- 

Regards,

David F Barrera
Linux Technology Center
Systems and Technology Group, IBM

"The wisest men follow their own direction. "
	
                          Euripides