Sanity Test Report for Yocto 1.0 RC2 20110305 Build

Sanity Test Report for Yocto 1.0 RC2 20110305 Build

[Xu, Jiajun]

[-- Attachment #1.1: Type: text/plain, Size: 4816 bytes --]

Hi all,

       This is the sanity test report for RC2 build 20110305. The major issue blocked QA testing is that all meta-intel BSP image outputs are not accessible. For qemuppc, sato-sdk build failed either. Compared with last report, there are 2 new bugs reported against this build. Meta-ide-support build failed with distro/bernard branch. USB stick is found not work on mpc8315e-rdb. Meanwhile, several zypper bugs(bug 721, 722, 749) are fixed, which make most zypper/rpm sanity tests pass.

      NOTE: Sanity test report only covers basic function check, which means some features are not tested. In attachment, you could find test cases run for sanity test. A complete fullpass test report will be sent out over the weekend.



Test Summary
---------------------------------------

Test Result Summary


Component

Target

Status

Comments


BSP

SugarBay

BLOCK

Build pass, but sharing folder is not accessible


　

CrownBay

BLOCK

Build pass, but sharing folder is not accessible


　

JasperForest

BLOCK

Build pass, but sharing folder is not accessible


　

Blacksand

BLOCK

Build pass, but sharing folder is not accessible


　

Beagleboard

GOOD

Only one RTC issue exists


　

Routerstationpro

GOOD

No test case failed


　

Mpc8315e-rdb

GOOD

Only USB stick does not work on this board


QEMU

qemux86

GOOD

　


　

qemux86-64

GOOD

zypper search segfault (bug 721) is fixed


　

qemuarm

GOOD

　


　

qemuppc

BLOCK

sato-sdk image build failed on autobuilder


　

qemumips

BUGGY

zypper segfault with this target; vnc client not pop-up fixing patch is not in this commit yet.


SDK

　

BLOCK

meta-ide-support not buildable with distro/bernard branch; unfs not work for qemuppc; i586 toolchain not build out;




　

Critical bugs, more than 50% test cases are blocked

　

Only Normal, Minor or Enhancement bugs, less than 10% test cases failed

　

Normal, Major and Critical bugs, more than 10% test cases failed


Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

BeagleBoard Sato

11

0

10

1 (bug 767)

0

BeagleBoard SDK

14

0

13

1 (bug 767)

0

Routerstationpro SDK

20

0

20

0

0

Mpc8315e-rdb SDK

23

0

19

4 (bug 817)

0

Qemux86-64 Sato

18

0

18

0

0

Qemux86-64 SDK

21

0

21

0

0

Qemux86 Sato

18

0

18

0

0

Qemux86 SDK

21

0

21

0

0

Qemumips Sato

15

0

13

2 (bug 825, 782)

0

Qemumips SDK

18

0

16

2 (bug 825, 782)

0

Qemuppc Sato

12

0

12

0

0

Qemuarm Sato

15

0

15

0

0

Qemuarm SDK

18

0

18

0

0

SDK

3

0

0

1 (bug 414, bug 819)

2 (Toolchain tarballs not built out for i586)

Total

227

0

214

11

2


* You can check the detailed test result in attachment for each target.

** The failed/blocked case number is listed with failed cases’ bug number.



Images
---------------------------------------

http://autobuilder.pokylinux.org/nightly/20110305-4/



Issue Summary
---------------------------------------

Zypper/RPM:

1.     New! [zypper] zypper segfault in qemumips sato/sdk images

http://bugzilla.pokylinux.org/show_bug.cgi?id=825



SDK:

1.     New! meta-ide-support build fail with distro/bernard brarnch

http://bugzilla.pokylinux.org/show_bug.cgi?id=819

2.     [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS

http://bugzilla.pokylinux.org/show_bug.cgi?id=414



BSP:

1.     New! USB stick do not work on mpc8315e-rdb (nightly build 20110305-4)

http://bugzilla.pokylinux.org/show_bug.cgi?id=817

2.     [RouterStationPro] Missing file when setting RTC on routerstationpro

http://bugzilla.pokylinux.org/show_bug.cgi?id=801

3.     [beagleboard] Can not set RTC correctly

http://bugzilla.pokylinux.org/show_bug.cgi?id=767



Others:

1.     The vnc client does not pop-up on qemumips-sato-sdk

http://bugzilla.pokylinux.org/show_bug.cgi?id=782



Verified Fixed Bugs:

1.     [zypper] zypper segfault in qemux86-64 sdk image

http://bugzilla.pokylinux.org/show_bug.cgi?id=721

2.     [qemuarm]zypper search package warning in sato image: no '/usr/bin/uuidgen'

http://bugzilla.pokylinux.org/show_bug.cgi?id=749

3.     [zypper]  search failure on qemuppc (nightly build 20110212-1)

http://bugzilla.pokylinux.org/show_bug.cgi?id=722

4.     [X11VNC Server ] No response when I click 'X11VNC Server' icon

http://bugzilla.pokylinux.org/show_bug.cgi?id=781





Best Regards,

Jiajun

[-- Attachment #1.2: Type: text/html, Size: 84031 bytes --]

[-- Attachment #2: M4-RC2_20110305_detail_testreport.ods --]
[-- Type: application/oleobject, Size: 15765 bytes --]

Re: Sanity Test Report for Yocto 1.0 RC2 20110305 Build

[Elizabeth Flanagan]

On 03/08/2011 07:45 PM, Xu, Jiajun wrote:
> Hi all,
> 
>        This is the sanity test report for RC2 build 20110305. The major issue blocked QA testing is that all meta-intel
> BSP image outputs are not accessible. 

I opened this up Tuesday evening and was unable to get network access last night. Please see:

For Sugarbay see: http://autobuilder02.pokylinux.org/sugarbay-bernard/nightly/20110307-1/
For Crownbay see: http://autobuilder02.pokylinux.org/crownbay-noemgd-bernard/nightly/20110307-1/
For Jasperforest see: http://autobuilder02.pokylinux.org/jasperforest-bernard/nightly/20110308-3/
For Blacksand see: http://autobuilder02.pokylinux.org/n450-bernard/nightly/20110307-1/

------------------
Elizabeth Flanagan
Yocto Project
Release Engineer