Re: Fullpass Test Report for Yocto 1.1 M1 RC2 - 20110528

[Saul Wold <sgw@linux.intel.com>]

On 06/06/2011 09:36 PM, Xu, Jiajun wrote:
> Hi all,
> 
> This is the fullpass test report for Yocto 1.1 M1 RC2 build. There are 3 
> new bugs found in this testing compared with weekly testing. Non-GPLv3 
> build could not work and one new LTP failure found with new kernel. The 
> 2 BLOCK issues on have been addressed and a new build is ready for QA 
> testing. Except for LTP and POSIX failures, there are 13 open bugs for 
> RC2 build. Grub installation fails on 3 intel BSPs. Graphics testing on 
> sugarbay is blocked because there are no mesa-demos and libSDL.so installed.
> 
Jiajun, Yi Zhao,

What's the status of the Beagleboard testing, you show blocked below,
but I thought we unblocked last week, so is there any update on the
status of beagleboard testing?  We need to know this since we have a
conditional GO decision based on these results.

I would like to also understand the sugarbay graphics testing, this is
not a blocker, it's a new requirement, correct?  We have not had
mesa-demos included in any past release.  I am going to add it to the
sato-sdk build only, will that be?

Sau!


> Helltest and Crashme could pass 24 hours testing on Jasperforest. Idle 
> power consumption of sugarbay and crownbay are 40.12W and 18.72W 
> respectively. LTP and POSIX testing is finished but the result analysis 
> is still on-going.
> 
> *Test Summary*
> 
> *---------------------------------------*
> 
> 						
> 
> 										
> 
> 														
> 
> 																
> 																				
> 																								
> 
> *Test Result Summary*
> 
> 	
> 
> *Component*
> 
> 	
> 
> *Target*
> 
> 	
> 
> *Status*
> 
> 	
> 
> *Comments*
> 
> 	
> 
> *BSP*
> 
> 	
> 
> SugarBay
> 
> 	
> 
> GOOD
> 
> 	
> 
> Graphics testing is blocked; soft keyboard will be triggered with 
> terminal icon;
> 
> 	
> 
> 　
> 
> 	
> 
> CrownBay
> 
> 	
> 
> GOOD
> 
> 	
> 
> Grub installation failed;
> 
> 	
> 
> 　
> 
> 	
> 
> JasperForest
> 
> 	
> 
> GOOD
> 
> 	
> 
> Everything runs well
> 
> 	
> 
> 　
> 
> 	
> 
> Blacksand
> 
> 	
> 
> GOOD
> 
> 	
> 
> Grub installation failed; S3 does not work;
> 
> 	
> 
> 　
> 
> 	
> 
> eMenlow
> 
> 	
> 
> GOOD
> 
> 	
> 
> System installation failed; S3 does not work;
> 
> 	
> 
> 　
> 
> 	
> 
> Beagleboard
> 
> 	
> 
> BLOCK
> 
> 	
> 
> Build failed; A new build is ready and QA is doing testing for it;
> 
> 	
> 
> 　
> 
> 	
> 
> Routerstationpro
> 
> 	
> 
> GOOD
> 
> 	
> 
> Everything runs well
> 
> 	
> 
> 　
> 
> 	
> 
> Mpc8315e-rdb
> 
> 	
> 
> Buggy
> 
> 	
> 
> USB does not work
> 
> 	
> 
> *QEMU*
> 
> 	
> 
> qemux86
> 
> 	
> 
> GOOD
> 
> 	
> 
> Everything runs well
> 
> 	
> 
> 　
> 
> 	
> 
> qemux86-64
> 
> 	
> 
> GOOD
> 
> 	
> 
> Everything runs well
> 
> 	
> 
> 　
> 
> 	
> 
> qemuarm
> 
> 	
> 
> GOOD
> 
> 	
> 
> Everything runs well
> 
> 	
> 
> 　
> 
> 	
> 
> qemuppc
> 
> 	
> 
> GOOD
> 
> 	
> 
> unfs does not work with qemuppc
> 
> 	
> 
> 　
> 
> 	
> 
> qemumips
> 
> 	
> 
> GOOD
> 
> 	
> 
> Everything runs well
> 
> 	
> 
> *Core Build System*
> 
> 	
> 
> 　
> 
> 	
> 
> Buggy
> 
> 	
> 
> non-GPLv3 build failed
> 
> 	
> 
> *Power/Performance*
> 
> 	
> 
> 　
> 
> 	
> 
> GOOD
> 
> 	
> 
> Power consumption of sugarbay and crownbay are 40.12W and 18.72W 
> respectively
> 
> 	
> 
> *Compliance*
> 
> 	
> 
> 　
> 
> 	
> 
> In analysis
> 
> 	
> 
> LTP result: https://wiki.pokylinux.org/wiki/LTP_result
> POSIX result: https://wiki.pokylinux.org/wiki/Posix_result
> 
> 	
> 
> *Stress*
> 
> 	
> 
> 　
> 
> 	
> 
> GOOD
> 
> 	
> 
> Helltest and crashme could pass 24 hours testing
> 
> 	
> 
> *ADT*
> 
> 	
> 
> 　
> 
> 	
> 
> Buggy
> 
> 	
> 
> unfs does not work with qemuppc
> 
> 	
> 
> 																													
> 
> **
> 
> 　
> 
> 	
> 
> Critical bugs, more than 50% test cases are blocked
> 
> 	
> 
> 　
> 
> 	
> 
> Only Normal, Minor or Enhancement bugs, less than 10% test cases failed
> 
> 	
> 
> 　
> 
> 	
> 
> Normal, Major and Critical bugs, more than 10% test cases failed
> 
> 	
> 
> 							
> 													
> 
> *Detailed Test Result for each component*
> 
> 	
> 
> *Target*
> 
> 	
> 
> *Total TCs***
> 
> 	
> 
> *Not Run*
> 
> 	
> 
> *Passed***
> 
> 	
> 
> *Failed***
> 
> 	
> 
> *Not testable (Blocked)***
> 
> 	
> 
> *Sugarbay Sato-SDK*
> 
> 	
> 
> 64
> 
> 	
> 
> 0
> 
> 	
> 
> 60
> 
> 	
> 
> 1 (bug 1101)
> 
> 	
> 
> 3 (bug 1112, 883)
> 
> 	
> 
> *Crownbay Sato-SDK*
> 
> 	
> 
> 60
> 
> 	
> 
> 0
> 
> 	
> 
> 55
> 
> 	
> 
> 1 (bug 1099)
> 
> 	
> 
> 4
> 
> 	
> 
> *Jasperforest LSB-SDK*
> 
> 	
> 
> 34
> 
> 	
> 
> 0
> 
> 	
> 
> 34
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *n450 Sato-SDK*
> 
> 	
> 
> 60
> 
> 	
> 
> 0
> 
> 	
> 
> 52
> 
> 	
> 
> 2 (bug 613, 1099)
> 
> 	
> 
> 6 (bug 613)
> 
> 	
> 
> *eMenlow Sato-SDK*
> 
> 	
> 
> 60
> 
> 	
> 
> 0
> 
> 	
> 
> 48
> 
> 	
> 
> 2 (bug 1099, 503)
> 
> 	
> 
> 6 (bug 503)
> 
> 	
> 
> *Routerstationpro Sato-SDK*
> 
> 	
> 
> 29
> 
> 	
> 
> 0
> 
> 	
> 
> 29
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Mpc8315e-rdb Sato-SDK*
> 
> 	
> 
> 30
> 
> 	
> 
> 0
> 
> 	
> 
> 26
> 
> 	
> 
> 4 (bug 766)
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemux86-64 Sato*
> 
> 	
> 
> 28
> 
> 	
> 
> 0
> 
> 	
> 
> 28
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemux86-64 Sato-SDK*
> 
> 	
> 
> 31
> 
> 	
> 
> 0
> 
> 	
> 
> 31
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemux86 Sato*
> 
> 	
> 
> 28
> 
> 	
> 
> 0
> 
> 	
> 
> 28
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemux86 Sato-SDK*
> 
> 	
> 
> 31
> 
> 	
> 
> 0
> 
> 	
> 
> 31
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemumips Sato*
> 
> 	
> 
> 26
> 
> 	
> 
> 0
> 
> 	
> 
> 26
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemumips Sato-SDK*
> 
> 	
> 
> 32
> 
> 	
> 
> 0
> 
> 	
> 
> 32
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemuppc Sato*
> 
> 	
> 
> 20
> 
> 	
> 
> 0
> 
> 	
> 
> 19
> 
> 	
> 
> 0
> 
> 	
> 
> 1 (bug 414)
> 
> 	
> 
> *Qemuppc Sato-SDK*
> 
> 	
> 
> 26
> 
> 	
> 
> 0
> 
> 	
> 
> 25
> 
> 	
> 
> 0
> 
> 	
> 
> 1 (bug 414)
> 
> 	
> 
> *Qemuarm Sato*
> 
> 	
> 
> 26
> 
> 	
> 
> 0
> 
> 	
> 
> 26
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Qemuarm Sato-SDK*
> 
> 	
> 
> 32
> 
> 	
> 
> 0
> 
> 	
> 
> 32
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Core Build System*
> 
> 	
> 
> 8
> 
> 	
> 
> 0
> 
> 	
> 
> 7
> 
> 	
> 
> 1 (bug 1133)
> 
> 	
> 
> 0
> 
> 	
> 
> *ADT*
> 
> 	
> 
> 6
> 
> 	
> 
> 0
> 
> 	
> 
> 5
> 
> 	
> 
> 1 (bug 414)
> 
> 	
> 
> 0
> 
> 	
> 
> *Power/Performance*
> 
> 	
> 
> 4
> 
> 	
> 
> 0
> 
> 	
> 
> 4
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Stress*
> 
> 	
> 
> 2
> 
> 	
> 
> 0
> 
> 	
> 
> 2
> 
> 	
> 
> 0
> 
> 	
> 
> 0
> 
> 	
> 
> *Total*
> 
> 	
> 
> 637
> 
> 	
> 
> 0
> 
> 	
> 
> 600
> 
> 	
> 
> 12
> 
> 	
> 
> 21
> 
> 	
> 
> 																			
> 
> **
> 
> 							
> 													
> 																			
> 																			
> 
> * You can check the detailed test result in attachment for each target.
> 
> ** The failed/blocked case number is listed with failed cases’ bug number.
> 
> *Commit Information*
> 
> *---------------------------------------*
> 
> Tree/Branch: Poky/1.1_M1
> 
> Poky Commit: 4ff7af11ef69849ef9c16f585eae58ac920b222b
> 
> Meta Branch: 1.1_M1
> 
> Meta Commit: fc719f0cd6530ce15148b4aa274f1644b461b298
> 
> *Issue Summary*
> 
> *---------------------------------------*
> 
> *Component*
> 
> 	
> 
> *Bug Number*
> 
> 	
> 
> *Target Milestone*
> 
> *System & Core OS*
> 
> 	
> 
> *Installation & Boot*
> 
> 	
> 
> Bug 1006: [mpc8315e-rdb & routerstationpro] minimal,sato,sato-sdk images 
> boot failed (nightly build 20110423-1)
> 
> 	
> 
> 1.1
> 
> Bug 1099: [blacksand/emenlow/crownbay] grub install failed with sato-sdk 
> live image
> 
> 	
> 
> 1.1 M2
> 
> *Power Mangement*
> 
> 	
> 
> Bug 613: [Blacksand]system cannot enter S3 standby mode
> 
> 	
> 
> 1.1
> 
> Bug 503: [emenlow] system cannot enter S3 standby mode
> 
> 	
> 
> 1.1
> 
> *Others*
> 
> 	
> 
> Bug 766: [mpc8315e-rdb] USB does not work on mpc8315e-rdb
> 
> 	
> 
> 1.0 M4
> 
> Bug 1101: keyboard pop up when clicking terminal icon
> 
> 	
> 
> 1.0 M2
> 
> Bug 1107: Open or add person in contacts may segfault on sugarbay/blacksand
> 
> 	
> 
> 1.1 M2
> 
> Bug 1097: The mouse can not click accurate to the icons in qemumips X
> 
> 	
> 
> 1.1 M2
> 
> *Graphics*
> 
> 	
> 
> Bug 1112: [sugarbay] mesa-demos should be added into sato image for 
> graphics testing
> 
> 	
> 
> 1.1 M2
> 
> Bug 883: [Sugarbay] GFX 3D game test fail to run with sugarbay BSP image 
> due to libsdl.so
> 
> 	
> 
> 1.1
> 
> *Multimedia*
> 
> 	
> 
> Works well in sugarbay/n450/eMenlow/crownbay
> 
> 	
> 
> 　
> 
> *Core Build System*
> 
> 	
> 
> New!Bug 1136: do_menuconfig for linux-yocto needs ${B} exists
> 
> New!Bug 1133: No provider for core-image-minimal/basic for non-GPLv3 build
> 
> 	
> 
> 1.1M2
> 
> 1.1 M2
> 
> *Compliance*
> 
> 	
> 
> Compliance testing is finished, but result is still under analysis. LTP 
> test result is on https://wiki.pokylinux.org/wiki/LTP_result
> 
> POSIX test result is on https://wiki.pokylinux.org/wiki/Posix_result
> 
> A new LTP failure is found and reported as bug 1138: [LTP] Some 
> growfiles cases failed with Yocto 1.1 M1 build.
> 
> 	
> 
> 　
> 
> *Stress*
> 
> 	
> 
> Helltest and Crashme could pass 24 hours testing
> 
> 	
> 
> 　
> 
> *ADT*
> 
> 	
> 
> Bug 414: [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS
> 
> 	
> 
> 1.1 M3
> 
> Best Regards,
> 
> Jiajun
> 
> 
> 
> _______________________________________________
> poky mailing list
> poky@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/poky