From: "Aníbal Limón" <anibal.limon@linux.intel.com>
To: openembedded-core@lists.openembedded.org
Subject: [PATCHv3 00/30] OEQA Framework Refactor & Improvements
Date: Thu, 8 Dec 2016 10:20:28 -0600 [thread overview]
Message-ID: <cover.1481213961.git.anibal.limon@linux.intel.com> (raw)
This patchset is related to OEQA Framework for details read the RFC send to the
Openembedded architecture ML.
http://lists.openembedded.org/pipermail/openembedded-architecture/2016-December/000351.html
Changes in v2: Fixes sdk extensible test case sdk_update.
Changes in v3: Squashed two commits related to d -> td and remove_safe function.
The following changes since commit 931ce04b0884ebe73158251d0d9a461214dfe1aa:
bitbake: toaster: Reference pip3 not pip (2016-12-08 15:52:08 +0000)
are available in the git repository at:
git://git.yoctoproject.org/poky-contrib alimon/oeqa_sdk_migration
http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=alimon/oeqa_sdk_migration
Aníbal Limón (26):
oeqa/core: Add base OEQA framework
oeqa/core: Add loader, context and decorator modules
oeqa/core/decorator: Add support for OETestDepends
oeqa/core/decorator: Add support for OETestDataDepends and
skipIfDataVar
scripts/oe-test: Add new oe-test script
oeqa/core/context: Add support of OETestContextExecutor
oeqa/core/cases: Add example test cases
oeqa/core: Add README
oe/data: Add export2json function
classes/rootfs-postcommands: Add write_image_test_data
classes/populate_sdk_base: Add write_sdk_test_data to postprocess
oeqa: Move common files to oeqa/files instead of runtime only
oeqa/sdk: Move test cases inside cases directory
oeqa/{runtime,sdk}/files: Move testsdkmakefile from runtime to sdk
module
oeqa/sdk: Add case and context modules for the SDK component
classes/testsdk: Migrates testsdk.bbclass to use new OESDKTestContext
oeqa/utils: Move targetbuild to buildproject module
oeqa/utils: {Target,SDK,}BuildProject remove dependency of bb
oeqa/sdk/cases: Migrate tests to the new OEQA framework
classes/testsdk: Remove the need of TEST_LOG_DIR variable
oeqa/sdkext: Move test cases inside cases directory
oeqa/sdkext: Adds case and context modules.
classes/testsdk: Migrate to use the new OESDKExtTestContext
oeqa/sdkext/cases: Migrate test case to new OEQA framework
oeqa/runtime: Fix TargetBuildProject instances
oeqa: Fix files handling on runtime tests.
Mariano Lopez (4):
oeqa/core: Add utils module for OEQA framework
oeqa/core/decorator: Add support for OETestID and OETestTag
oeqa/core/decorator: Add support for OETimeout decorator
oeqa/core: Add tests for the OEQA framework
meta/classes/populate_sdk_base.bbclass | 9 +-
meta/classes/rootfs-postcommands.bbclass | 18 ++
meta/classes/testexport.bbclass | 5 +
meta/classes/testimage.bbclass | 4 +
meta/classes/testsdk.bbclass | 162 ++++++++------
meta/lib/oe/data.py | 28 +++
meta/lib/oeqa/core/README | 38 ++++
meta/lib/oeqa/core/__init__.py | 0
meta/lib/oeqa/core/case.py | 46 ++++
meta/lib/oeqa/core/cases/__init__.py | 0
meta/lib/oeqa/core/cases/example/data.json | 1 +
meta/lib/oeqa/core/cases/example/test_basic.py | 20 ++
meta/lib/oeqa/core/context.py | 225 ++++++++++++++++++++
meta/lib/oeqa/core/decorator/__init__.py | 71 +++++++
meta/lib/oeqa/core/decorator/data.py | 36 ++++
meta/lib/oeqa/core/decorator/depends.py | 94 +++++++++
meta/lib/oeqa/core/decorator/oeid.py | 23 ++
meta/lib/oeqa/core/decorator/oetag.py | 24 +++
meta/lib/oeqa/core/decorator/oetimeout.py | 25 +++
meta/lib/oeqa/core/exception.py | 14 ++
meta/lib/oeqa/core/loader.py | 235 +++++++++++++++++++++
meta/lib/oeqa/core/runner.py | 76 +++++++
meta/lib/oeqa/core/tests/__init__.py | 0
meta/lib/oeqa/core/tests/cases/data.py | 20 ++
meta/lib/oeqa/core/tests/cases/depends.py | 38 ++++
.../oeqa/core/tests/cases/loader/invalid/oeid.py | 15 ++
.../oeqa/core/tests/cases/loader/valid/another.py | 9 +
meta/lib/oeqa/core/tests/cases/oeid.py | 18 ++
meta/lib/oeqa/core/tests/cases/oetag.py | 18 ++
meta/lib/oeqa/core/tests/cases/timeout.py | 18 ++
meta/lib/oeqa/core/tests/common.py | 35 +++
meta/lib/oeqa/core/tests/test_data.py | 51 +++++
meta/lib/oeqa/core/tests/test_decorators.py | 135 ++++++++++++
meta/lib/oeqa/core/tests/test_loader.py | 86 ++++++++
meta/lib/oeqa/core/tests/test_runner.py | 38 ++++
meta/lib/oeqa/core/utils/__init__.py | 0
meta/lib/oeqa/core/utils/misc.py | 37 ++++
meta/lib/oeqa/core/utils/path.py | 19 ++
meta/lib/oeqa/core/utils/test.py | 71 +++++++
meta/lib/oeqa/{runtime => }/files/test.c | 0
meta/lib/oeqa/{runtime => }/files/test.cpp | 0
meta/lib/oeqa/{runtime => }/files/test.pl | 0
meta/lib/oeqa/{runtime => }/files/test.py | 0
meta/lib/oeqa/oetest.py | 92 +-------
meta/lib/oeqa/runtime/buildcvs.py | 9 +-
meta/lib/oeqa/runtime/buildgalculator.py | 8 +-
meta/lib/oeqa/runtime/buildiptables.py | 8 +-
meta/lib/oeqa/runtime/gcc.py | 4 +-
meta/lib/oeqa/runtime/perl.py | 2 +-
meta/lib/oeqa/runtime/python.py | 2 +-
meta/lib/oeqa/runtime/utils/__init__.py | 0
meta/lib/oeqa/runtime/utils/targetbuildproject.py | 33 +++
meta/lib/oeqa/sdk/__init__.py | 3 -
meta/lib/oeqa/sdk/case.py | 12 ++
meta/lib/oeqa/sdk/{ => cases}/buildcvs.py | 15 +-
meta/lib/oeqa/sdk/{ => cases}/buildgalculator.py | 28 ++-
meta/lib/oeqa/sdk/{ => cases}/buildiptables.py | 16 +-
meta/lib/oeqa/sdk/cases/gcc.py | 43 ++++
meta/lib/oeqa/sdk/cases/perl.py | 27 +++
meta/lib/oeqa/sdk/{ => cases}/python.py | 25 ++-
meta/lib/oeqa/sdk/context.py | 133 ++++++++++++
.../oeqa/{runtime => sdk}/files/testsdkmakefile | 0
meta/lib/oeqa/sdk/gcc.py | 36 ----
meta/lib/oeqa/sdk/perl.py | 28 ---
meta/lib/oeqa/sdk/utils/__init__.py | 0
meta/lib/oeqa/sdk/utils/sdkbuildproject.py | 45 ++++
meta/lib/oeqa/sdkext/__init__.py | 3 -
meta/lib/oeqa/sdkext/case.py | 21 ++
meta/lib/oeqa/sdkext/{ => cases}/devtool.py | 49 +++--
meta/lib/oeqa/sdkext/{ => cases}/sdk_update.py | 17 +-
meta/lib/oeqa/sdkext/context.py | 21 ++
meta/lib/oeqa/utils/buildproject.py | 52 +++++
meta/lib/oeqa/utils/targetbuild.py | 135 ------------
scripts/oe-test | 98 +++++++++
74 files changed, 2284 insertions(+), 443 deletions(-)
create mode 100644 meta/lib/oeqa/core/README
create mode 100644 meta/lib/oeqa/core/__init__.py
create mode 100644 meta/lib/oeqa/core/case.py
create mode 100644 meta/lib/oeqa/core/cases/__init__.py
create mode 100644 meta/lib/oeqa/core/cases/example/data.json
create mode 100644 meta/lib/oeqa/core/cases/example/test_basic.py
create mode 100644 meta/lib/oeqa/core/context.py
create mode 100644 meta/lib/oeqa/core/decorator/__init__.py
create mode 100644 meta/lib/oeqa/core/decorator/data.py
create mode 100644 meta/lib/oeqa/core/decorator/depends.py
create mode 100644 meta/lib/oeqa/core/decorator/oeid.py
create mode 100644 meta/lib/oeqa/core/decorator/oetag.py
create mode 100644 meta/lib/oeqa/core/decorator/oetimeout.py
create mode 100644 meta/lib/oeqa/core/exception.py
create mode 100644 meta/lib/oeqa/core/loader.py
create mode 100644 meta/lib/oeqa/core/runner.py
create mode 100644 meta/lib/oeqa/core/tests/__init__.py
create mode 100644 meta/lib/oeqa/core/tests/cases/data.py
create mode 100644 meta/lib/oeqa/core/tests/cases/depends.py
create mode 100644 meta/lib/oeqa/core/tests/cases/loader/invalid/oeid.py
create mode 100644 meta/lib/oeqa/core/tests/cases/loader/valid/another.py
create mode 100644 meta/lib/oeqa/core/tests/cases/oeid.py
create mode 100644 meta/lib/oeqa/core/tests/cases/oetag.py
create mode 100644 meta/lib/oeqa/core/tests/cases/timeout.py
create mode 100644 meta/lib/oeqa/core/tests/common.py
create mode 100755 meta/lib/oeqa/core/tests/test_data.py
create mode 100755 meta/lib/oeqa/core/tests/test_decorators.py
create mode 100755 meta/lib/oeqa/core/tests/test_loader.py
create mode 100755 meta/lib/oeqa/core/tests/test_runner.py
create mode 100644 meta/lib/oeqa/core/utils/__init__.py
create mode 100644 meta/lib/oeqa/core/utils/misc.py
create mode 100644 meta/lib/oeqa/core/utils/path.py
create mode 100644 meta/lib/oeqa/core/utils/test.py
rename meta/lib/oeqa/{runtime => }/files/test.c (100%)
rename meta/lib/oeqa/{runtime => }/files/test.cpp (100%)
rename meta/lib/oeqa/{runtime => }/files/test.pl (100%)
rename meta/lib/oeqa/{runtime => }/files/test.py (100%)
create mode 100644 meta/lib/oeqa/runtime/utils/__init__.py
create mode 100644 meta/lib/oeqa/runtime/utils/targetbuildproject.py
create mode 100644 meta/lib/oeqa/sdk/case.py
rename meta/lib/oeqa/sdk/{ => cases}/buildcvs.py (59%)
rename meta/lib/oeqa/sdk/{ => cases}/buildgalculator.py (45%)
rename meta/lib/oeqa/sdk/{ => cases}/buildiptables.py (58%)
create mode 100644 meta/lib/oeqa/sdk/cases/gcc.py
create mode 100644 meta/lib/oeqa/sdk/cases/perl.py
rename meta/lib/oeqa/sdk/{ => cases}/python.py (46%)
create mode 100644 meta/lib/oeqa/sdk/context.py
rename meta/lib/oeqa/{runtime => sdk}/files/testsdkmakefile (100%)
delete mode 100644 meta/lib/oeqa/sdk/gcc.py
delete mode 100644 meta/lib/oeqa/sdk/perl.py
create mode 100644 meta/lib/oeqa/sdk/utils/__init__.py
create mode 100644 meta/lib/oeqa/sdk/utils/sdkbuildproject.py
create mode 100644 meta/lib/oeqa/sdkext/case.py
rename meta/lib/oeqa/sdkext/{ => cases}/devtool.py (73%)
rename meta/lib/oeqa/sdkext/{ => cases}/sdk_update.py (63%)
create mode 100644 meta/lib/oeqa/sdkext/context.py
create mode 100644 meta/lib/oeqa/utils/buildproject.py
delete mode 100644 meta/lib/oeqa/utils/targetbuild.py
create mode 100755 scripts/oe-test
--
2.1.4
next reply other threads:[~2016-12-08 16:18 UTC|newest]
Thread overview: 31+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-12-08 16:20 Aníbal Limón [this message]
2016-12-08 16:20 ` [PATCHv3 01/30] oeqa/core: Add base OEQA framework Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 02/30] oeqa/core: Add utils module for " Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 03/30] oeqa/core: Add loader, context and decorator modules Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 04/30] oeqa/core/decorator: Add support for OETestDepends Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 05/30] oeqa/core/decorator: Add support for OETestID and OETestTag Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 06/30] oeqa/core/decorator: Add support for OETimeout decorator Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 07/30] oeqa/core/decorator: Add support for OETestDataDepends and skipIfDataVar Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 08/30] oeqa/core: Add tests for the OEQA framework Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 09/30] scripts/oe-test: Add new oe-test script Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 10/30] oeqa/core/context: Add support of OETestContextExecutor Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 11/30] oeqa/core/cases: Add example test cases Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 12/30] oeqa/core: Add README Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 13/30] oe/data: Add export2json function Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 14/30] classes/rootfs-postcommands: Add write_image_test_data Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 15/30] classes/populate_sdk_base: Add write_sdk_test_data to postprocess Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 16/30] oeqa: Move common files to oeqa/files instead of runtime only Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 17/30] oeqa/sdk: Move test cases inside cases directory Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 18/30] oeqa/{runtime, sdk}/files: Move testsdkmakefile from runtime to sdk module Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 19/30] oeqa/sdk: Add case and context modules for the SDK component Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 20/30] classes/testsdk: Migrates testsdk.bbclass to use new OESDKTestContext Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 21/30] oeqa/utils: Move targetbuild to buildproject module Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 22/30] oeqa/utils: {Target, SDK, }BuildProject remove dependency of bb Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 23/30] oeqa/sdk/cases: Migrate tests to the new OEQA framework Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 24/30] classes/testsdk: Remove the need of TEST_LOG_DIR variable Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 25/30] oeqa/sdkext: Move test cases inside cases directory Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 26/30] oeqa/sdkext: Adds case and context modules Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 27/30] classes/testsdk: Migrate to use the new OESDKExtTestContext Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 28/30] oeqa/sdkext/cases: Migrate test case to new OEQA framework Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 29/30] oeqa/runtime: Fix TargetBuildProject instances Aníbal Limón
2016-12-08 16:20 ` [PATCHv3 30/30] oeqa: Fix files handling on runtime tests Aníbal Limón
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1481213961.git.anibal.limon@linux.intel.com \
--to=anibal.limon@linux.intel.com \
--cc=openembedded-core@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.