oFono upstream test results_20130808

[Nicolas Paccou <nicolas.paccou@linux.intel.com>]

[-- Attachment #1: Type: text/plain, Size: 4225 bytes --]

Hello all,

 

Please find the test report of oFono v1.12 commit b131cfd.

 

During this testing, we ran 34 functional positive cases. 31 cases passed, 0
failed and 3 are blocked (due to expiration of network simulator license,
renewal have been ordered). No new issue has been found.

 

If you have any comment about this report, tell me please.

 

 

Test Objective

 

As there was only specific changes (for SIMCOM/sim900) since the previous
tests cycle, the aim of this session was to validate the state of oFono
upstream by testing only major tests of most important features over all
material we had (according to what feature was supported and by priority
order: PR3, Network Simulator, 3G dongle, phonesim). oFono has been
installed and tested on smartphone running Tizen 2.0 and Ubuntu 12.04
device.

 

 

Test Environment

 

For all Setup:

oFono: v1.12 (updated to commit b131cfd)

 

-      Smartphone Setup:

Image: Tizen 2.0 image

Operator & SIM Card: SFR SIM Card - Phone number +33623312183

 

-      Laptop + 3G Dongle/Phonesim:

usb_modeswitch: v1.2.5

modeswitch data: 20130610

Hardware: Laptop

Ubuntu: v12.04

Modem: Huawei E173u-2 - Operator & SIM Card: SFR SIM Card - Phone number
+33623312183

Phonesim: v1.19 (updated to commit c94e6c0)

 

 

 

Issue Summary

 

New bug: 0

None

 

Known bug: 1


T

Key

Summary

Components

Severity

P

Status

Resolution

Assignee

Reporter


 <https://01.org/jira/browse/OF-162> Bug

OF-162 <https://01.org/jira/browse/OF-162> 

 <https://01.org/jira/browse/OF-162> Going back from a select item list
releases the session

 <https://01.org/jira/browse/OF/component/10501> OFono AT Modem

Normal

	OpenOpen

Unresolved

 
<https://01.org/jira/secure/ViewProfile.jspa?name=denis.kenzior%40intel.com>
Denis Kenzior

 <https://01.org/jira/secure/ViewProfile.jspa?name=npaccou> Paccou Nicolas

 

Closed bug: 0

None

 

 

Test Result

 

SUMMARY

Total Test Case                  34

Passed                              31

Failed                                0

Blocked                             3

TCs completed                   100%

Run rate                            91%

Pass rate total                    91%

Blocked rate total               9%

Pass rate of executed          100%

 

FEATURES                         Total   Pass    Fail     Blocked
Pass %          Modem Used

Modem                              5        5        0        0
100%            Tested on smartphone using a real SIM Card or on Laptop
using 3G Dongle

SIM                                   4        4        0        0
100%            Tested on smartphone using a real SIM Card or on Laptop
using 3G Dongle

Network                            2        2        0        0
100%             Tested on smartphone using a real SIM

Connectivity                      8        8        0        0
100%             Tested on smartphone using a real SIM Card or on Laptop
using 3G Dongle

Voice Calls                        12       9       0         3
75%            Tested on smartphone with appropriate SIM Card

Messaging                         2        2        0        0
100%            Tested on smartphone using a real SIM

Message Waiting                1        1        0        0
100%            Tested on Laptop using Phonesim

 

Please find details in the attached file.

 

 

Notes

 

Please note that I have found two oFono crashes on the following conditions:


-      OF-163 <https://01.org/jira/browse/OF-163>  - oFono crashes when
doing a NAA Initialization+File Change Notification after having done a NAA
Initialization+Full File Change Notification with Phonesim.

-      OF-167 <https://01.org/jira/browse/OF-167>  -
<https://01.org/jira/browse/OF-167> oFono crashes when receiving a voicemail
notification on real network (Bouygues Telecom)

 

9% of cases are blocked due to:

-      Missing software (due to expiration of network simulator license,
renewal have been ordered)

 

Best regards,

Nicolas


[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 26329 bytes --]

[-- Attachment #3: image001.png --]
[-- Type: image/png, Size: 1078 bytes --]

[-- Attachment #4: image002.png --]
[-- Type: image/png, Size: 1081 bytes --]

[-- Attachment #5: oFono1.12_b131cfd_BAT_TitlesOnly.xlsx --]
[-- Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet, Size: 30558 bytes --]