oFono upstream test results_20120913

oFono upstream test results_20120913

[Nicolas Paccou]

[-- Attachment #1: Type: text/plain, Size: 4177 bytes --]

Hello all,

 

Please find the test report of oFono v1.10 commit 006a37c.

During this testing, we ran 462 functional positive cases. 348 cases passed
and 114 are blocked due to missing software/missing hardware/Feature not
supported. The pass rate is 75% (-1%) which is similar to previous test
cycle (v1.10 commit 2d2075c).

We found, reopened and verified no issue.

 

If you have any comment about this report, contact me please.

 

Test Objective

 

The aim of this test cycle was to validate the state of oFono upstream by
testing all its features over all material we had (according to what feature
was supported and by priority order: 3G dongle and phonesim). oFono has been
installed and tested on Ubuntu 12.04 device.

 

 

Test Environment

 

oFono: v1.10 (updated to commit 006a37c)

usb_modeswitch: v1.2.3

modeswitch data: 20120120

Hardware: Laptop

Ubuntu: v12.04

Modem: Huawei E173u-2 - Operator & SIM Card: Orange SIM Card (data only) -
Phone number +33677646185 and other specific SIM Cards

Phonesim: v1.19 (updated to commit d7f1f1a)

 

 

Issue Summary

 

New bug:

None

 

Known bug:

None

 

Closed bug:

None

 

 

Test Result

 

SUMMARY

Total Test Case                  462

Passed                              348

Failed                                0

Blocked                             114

TCs completed                   100,0%

Run rate                            75% (-1%)

Pass rate total                    75% (-1%)

Blocked rate total               25% (+1%)

Pass rate of executed         100%

 

 

FEATURES                         TOTAL PASS  FAIL             BLOCKED
PASS %        MODEM USED

Modem                              16      16      0                   0
100%            3G Dongle

SIM                                   20      20      0                  0
100%            3G Dongle

Phonebook                         1        1        0                  0
100%            3G Dongle

Network                            18      18      0                   0
100%            3G Dongle

Radio                                22      17      0                   5
77%             3G Dongle

Connectivity                      28      28      0                   0
100%            3G Dongle

Voice Calls                         50      40      0                  10
80%             mainly on 3G Dongle (using appropriate SIM Card)

Messaging                         24      22      0                   2
92%             3G Dongle (using appropriate SIM Card)

Smart Messaging               15      15      0                  0
100%            Phonesim

Message Waiting                8        8        0                  0
100%            Phonesim

Cell Broadcast                    15      13      0                  2
87%             Phonesim

Call Settings                      13      9        0                  4
69%             3G Dongle

Supplementary Services     59      55      0                  4
93%             mainly on Phonesim

Call Meter                          15      5        0                  10
33%             mainly on Phonesim

Call Barring                       49      33      0                   16
67%             3G Dongle (using appropriate SIM Cards)

Call Forwarding                  5        5        0                  0
100%            Phonesim

SimToolKit                        104     43      0                  61
41%             Phonesim

 

Please find details in the attached file.

 

Notes

 

25% of cases are blocked due to:

Missing software (e.g.: Missing feature in Phonesim or missing a visual
application for some blocked feature as Setup Idle ModeText, Select Item,
Send SMS, etc.)

Missing hardware (e.g.: Missing other SIM (having appropriate service
activated) or modem to be able to test certain feature or case (e.g.:
network simulator or smartphone device to test PIN/PIN2 cases, Call Barring
etc.).

Feature not supported by oFono.

 

Best regards,

Nicolas


[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 18232 bytes --]

[-- Attachment #3: oFono1.10_006a37c_TCs_TitlesOnly.xlsx --]
[-- Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet, Size: 79368 bytes --]