From: Nicolas Paccou <nicolas.paccou@linux.intel.com>
To: ofono@ofono.org
Subject: oFono upstream test results_20120814
Date: Tue, 14 Aug 2012 18:16:32 +0200 [thread overview]
Message-ID: <000001cd7a38$2c011c80$84035580$@linux.intel.com> (raw)
[-- Attachment #1: Type: text/plain, Size: 4283 bytes --]
Hello all,
Please find the test report of oFono v1.10 commit 2d2075c.
During this testing, we ran 462 functional positive cases. 351 cases passed
and 111 are blocked due to missing software/missing hardware/Feature not
supported. The pass rate is 76% (+1%) which is similar to previous test
cycle (v1.6).
We found, reopened and verified no issue.
If you have any comment about this report, contact me please.
Test Objective
The aim of this test cycle was to validate the state of oFono upstream by
testing all its features over all material we had (according to what feature
was supported and by priority order: 3G dongle and phonesim). oFono has been
installed and tested on Ubuntu 12.04 device.
Test Environment
oFono: v1.10 (updated to commit 2d2075c)
usb_modeswitch: v1.2.3
modeswitch data: 20120120
Hardware: Laptop
Ubuntu: v12.04
Modem: Huawei E173u-2 - Operator & SIM Card: Orange SIM Card (data only) -
Phone number +33677646185 and other specific SIM Cards
Phonesim: v1.18 (updated to commit 95248ae)
Issue Summary
New bug:
None
Known bug:
None
Closed bug:
None
Test Result
SUMMARY
Total Test Case 462
Passed 351
Failed 0
Blocked 111
TCs completed 100,0%
Run rate 76% (+1%)
Pass rate total 76% (+1%)
Blocked rate total 24% (-1%)
Pass rate of executed 100%
FEATURES TOTAL PASS FAIL BLOCKED
PASS % MODEM USED
Modem 16 16 0 0
100% 3G Dongle
SIM 20 20 0 0
100% 3G Dongle
Phonebook 1 1 0 0
100% 3G Dongle
Network 18 18 0 0
100% 3G Dongle
Radio 22 17 0 5
77% 3G Dongle
Connectivity 28 28 0 0
100% 3G Dongle
Voice Calls 50 41 0 9
82% mainly on 3G Dongle (using appropriate SIM Card)
Messaging 24 22 0 2
92% 3G Dongle (using appropriate SIM Card)
Smart Messaging 15 15 0 0
100% Phonesim
Message Waiting 8 8 0 0
100% Phonesim
Cell Broadcast 15 15 0 0
100% Phonesim
Call Settings 13 9 0 4
69% 3G Dongle
Supplementary Services 59 55 0 4
93% mainly on Phonesim
Call Meter 15 5 0 10
33% mainly on Phonesim
Call Barring 49 33 0 16
67% 3G Dongle (using appropriate SIM Cards)
Call Forwarding 5 5 0 0
100% Phonesim
SimToolKit 104 43 0 61
41% Phonesim
Please find details in the attached file
Notes
24% of cases are blocked due to:
Missing software (e.g.: Missing feature in Phonesim or missing a visual
application for some blocked feature as Setup Idle ModeText, Select Item,
Send SMS, etc.)
Missing hardware (e.g.: Missing other SIM (having appropriate service
activated) or modem to be able to test certain feature or case (e.g.:
network simulator or smartphone device to test PIN/PIN2 cases, Call Barring
etc.). Note that we have asked for PUK1 and PUK2 codes of Network Simulator
SIM in order to be able to run those tests next time.
Feature not supported by oFono
Best regards,
Nicolas
[-- Attachment #2: attachment.html --]
[-- Type: text/html, Size: 18964 bytes --]
[-- Attachment #3: oFono1.10_2d2075c_TCs_TitlesOnly.xlsx --]
[-- Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet, Size: 74694 bytes --]
reply other threads:[~2012-08-14 16:16 UTC|newest]
Thread overview: [no followups] expand[flat|nested] mbox.gz Atom feed
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='000001cd7a38$2c011c80$84035580$@linux.intel.com' \
--to=nicolas.paccou@linux.intel.com \
--cc=ofono@ofono.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.