oFono upstream test results_20130603

oFono upstream test results_20130603

[Nicolas Paccou]

[-- Attachment #1: Type: text/plain, Size: 4446 bytes --]

Hello all,

 

Please find the test report of oFono v1.12 commit 53a0fa8.

 

During this testing, we ran 197 functional positive cases. 144 cases passed,
1 failed and 52 are blocked due to missing software/missing hardware/Feature
not supported. No new issue has been found.

 

If you have any comment about this report, contact me please.

 

 

Test Objective

 

As there was only few changes (3) since the previous tests cycle, the aim of
this session was to validate the state of oFono upstream by testing only
major tests of most important features and all tests of features impacted by
last commits (GSM shortcut of Supplementary Services and STK) over all
material we had (according to what feature was supported and by priority
order: PR3, Network Simulator, 3G dongle, phonesim). oFono has been
installed and tested on PR3 running Tizen 2.1 and Ubuntu 12.04 device.

 

 

Test Environment

 

For all Setup:

oFono: v1.12 (updated to commit 53a0fa8)

 

-      Smartphone device Setup:

Image: Tizen Mobile 2.1

Operator & SIM Card: several french and UK SIM Cards according to features

 

-      Laptop + 3G Dongle/Phonesim:

usb_modeswitch: v1.2.3

modeswitch data: 20120120

Hardware: Laptop

Ubuntu: v12.04

Modem: Huawei E173u-2 - Operator & SIM Card: several french and UK SIM Cards
according to features

Phonesim: v1.19 (updated to commit c94e6c0)

     

-      Laptop + HFP

HFP Server:

Hardware: Laptop

Ubuntu: v12.04

Bluez 4.101 (updated to commit 67ef3ac)

oFono has been installed with "--enable-bluez4" option instead of using
default bluez5 plugin (unable to make HFP using this one)

HFP Client: Android JB device

 

 

Issue Summary

 

New bug: 0

None

 

Known bug: 1

Bug 25982 <https://bugs.meego.com/show_bug.cgi?id=25982>  - Going back from
a select item list releases the session

 

Closed bug: 0

None

 

 

Test Result

 

SUMMARY

Total Test Case                  197

Passed                              144

Failed                                1

Blocked                             52

TCs completed                   100,0%

Run rate                            74%

Pass rate total                    73%

Blocked rate total               26%

Pass rate of executed          100%

 

FEATURES                         Total   Pass    Fail     Blocked
Pass %          Modem Used

Modem                              5        5        0        0
100%            Tested on smartphone using a real SIM Card and on Laptop
using 3G Dongle or using HFP

SIM                                   4        4        0        0
100%            Tested on smartphone using a real SIM Card and on Laptop
using 3G Dongle

Network                            2        2        0        0
100%            Tested on smartphone using a real SIM

Connectivity                      8        8        0        0
100%            Tested on smartphone using a real SIM

Voice Calls                         12      12      0        0
100%            Tested on smartphone with appropriate SIM Card or using
Network Simulator

Messaging                         2        2        0        0
100%            Tested on smartphone using a real SIM

Message Waiting                1        1        0        0
100%            Tested on Laptop using Phonesim

Supplementary Services     59      56      0        3                  95%
Tested on smartphone with appropriate SIM Card

SimToolKit                        104     54      1        49
52%             Tested on Laptop using Phonesim

 

Please find details in the attached file.

 

 

Notes

 

Please note that I have found a crash of oFono when running two STK TCs in a
row: 

Bug <https://bugs.meego.com/show_bug.cgi?id=25998>  25998 - oFono crashes
when doing a NAA Initialization+File Change Notification after having done a
NAA Initialization+Full File Change Notification with Phonesim.

 

26% of cases are blocked due to:

-      Missing software (e.g.: Missing feature in Phonesim or missing a
visual application for some blocked feature as Setup Idle ModeText, Select
Item, Send SMS, etc.)

-      Missing hardware (e.g.: Missing other SIM (having appropriate service
activated).

-      Feature not supported by oFono

 

Best regards,

Nicolas


[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 21436 bytes --]

[-- Attachment #3: oFono1.12_53a0fa8_BAT_TitlesOnly.xlsx --]
[-- Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet, Size: 47725 bytes --]