Openembedded Core Discussions
 help / color / mirror / Atom feed
From: "Aníbal Limón" <anibal.limon@linux.intel.com>
To: openembedded-core@lists.openembedded.org
Cc: joshua.g.lock@intel.com
Subject: [PATCHv2 00/29] oeqa core and oe-selftest threaded enablement
Date: Wed, 12 Jul 2017 14:36:46 -0500	[thread overview]
Message-ID: <cover.1499887935.git.anibal.limon@linux.intel.com> (raw)

The v2 address comments did by Patrick about add better explanation
on the commit messages and some typos.

Other interesting information to add is that with this series we will
able to execute oe-selftest in around half [1] of the original time [2],
(9406.782s vs 17303.014s).

[1] https://bugzilla.yoctoproject.org/attachment.cgi?id=3863
[2] https://bugzilla.yoctoproject.org/attachment.cgi?id=3864

This series is to enable oe-selftest threaded runs along some fixes,

* Implementation of main/end thread usage in oeqa threaded
* Adaptation of oe-selftest cases to be able to run in threaded env,
  ** Usage of own build directory by Test class.
  ** Mark the test modules that are enabled to run into a thread.
  ** Split some test modules because aren't support run into a thread
     due to bitbake/tinfoil constraints.

The oe-selftest script now has an cmdline option (-t) to enable threaded
runs, by default is set to 1, this needs to be set manually because 
depending on HW resources available can cause ran out of cpu/memory.

By default the oe-selftest cases runs on the main thread and uses
the main build directory for compatibility purposes.

The following changes since commit 81498aac9560fbeaeb58eaada32ce80e0ea51628:

  yocto-project-qs: Updated Next Steps list (2017-07-12 00:28:16 +0100)

are available in the git repository at:

  git://git.yoctoproject.org/poky-contrib alimon/oe_selftest_threaded
  http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=alimon/oe_selftest_threaded

Aníbal Limón (29):
  oeqa/core/loader: Switch method definition for _make_failed_test
  oeqa/selftest/{context,case}: Handle KeyboardInterrupt/SIGINT and
    SIGTERM
  selftest/cases/package: Call parent setUpClass method
  bb/tinfoil: run_command handle busy status in bitbake server
  oe/copy_buildsystem: check_sstate_task_list also pop BBPATH from env
  oeqa/core/threaded: Enable support to use the main thread
  oeqa/core/threaded: Add support to run into a thread at end of
    execution
  oeqa/core/threaded: logSummary add skipped tests info
  oeqa/core/tests: Update test_loader threaded to cover main thread
    usage
  oeqa/selftest/{case,context}: Add builddir by test class and context
  oeqa/selftest/case: Add wrappers to utils.commands modules
  oeqa/selftest/case: Creates meta-selftest layer per class
  oeqa/selftest/case: tearDown extra commands print what actually fails
  oeqa/selftest/case: Support bitbake memres mode in per build directory
  oeqa/selftest/cases: Use testlayer_path instead of call
    get_test_layer()
  oeqa/selftest/cases: Use builddir from class instead of get from
    environment
  oeqa/selftest/cases: Use wrapper methods from OESelfTestCase class
  oeqa/selftest/cases: imagefeatures enable threaded runs
  oeqa/selftest/cases: runqemu enable threaded runs
  oeqa/selftest/cases: runtime enable threaded runs
  oeqa/selftest/cases: eSDK enable threaded runs
  oeqa/selftest/cases: devtool enable threaded runs
  oeqa/selftest/cases: recipetool enable for threaded runs
  oeqa/selftest/cases: Move devtool deploy test case to own module
  selftest/cases/devtool{,end}: Move update/finish_modify tests to its
    own module
  seltest/cases/devtool: Build dbus on test_devtool_add_git_local
  argparse_oe: Add int_positive type
  oeqa/selftest/context: Enable support for threaded runs
  oeqa/selftest/cases: systemd_boot enable threaded runs

 bitbake/lib/bb/tinfoil.py                          |   23 +-
 .../lib/oeqa/selftest/cases/systemd_boot.py        |   26 +-
 meta/lib/oe/copy_buildsystem.py                    |    1 +
 meta/lib/oeqa/core/loader.py                       |    4 +-
 meta/lib/oeqa/core/tests/test_loader.py            |   17 +-
 meta/lib/oeqa/core/threaded.py                     |  169 +++-
 meta/lib/oeqa/selftest/case.py                     |  251 ++++-
 .../lib/oeqa/selftest/cases/_sstatetests_noauto.py |   23 +-
 meta/lib/oeqa/selftest/cases/archiver.py           |   21 +-
 meta/lib/oeqa/selftest/cases/bblayers.py           |   45 +-
 meta/lib/oeqa/selftest/cases/bbtests.py            |  103 +-
 meta/lib/oeqa/selftest/cases/buildhistory.py       |    9 +-
 meta/lib/oeqa/selftest/cases/buildoptions.py       |   51 +-
 meta/lib/oeqa/selftest/cases/containerimage.py     |    9 +-
 meta/lib/oeqa/selftest/cases/devtool.py            | 1014 +++++---------------
 meta/lib/oeqa/selftest/cases/devtool_deploy.py     |   93 ++
 meta/lib/oeqa/selftest/cases/devtool_end.py        |  506 ++++++++++
 meta/lib/oeqa/selftest/cases/distrodata.py         |    7 +-
 meta/lib/oeqa/selftest/cases/eSDK.py               |   61 +-
 meta/lib/oeqa/selftest/cases/image_typedep.py      |    8 +-
 meta/lib/oeqa/selftest/cases/imagefeatures.py      |   78 +-
 meta/lib/oeqa/selftest/cases/imagefeatures_boot.py |   63 ++
 meta/lib/oeqa/selftest/cases/layerappend.py        |   22 +-
 meta/lib/oeqa/selftest/cases/liboe.py              |   13 +-
 meta/lib/oeqa/selftest/cases/lic_checksum.py       |    8 +-
 meta/lib/oeqa/selftest/cases/manifest.py           |   13 +-
 meta/lib/oeqa/selftest/cases/oelib/buildhistory.py |    7 +-
 meta/lib/oeqa/selftest/cases/oescripts.py          |    5 +-
 meta/lib/oeqa/selftest/cases/package.py            |   12 +-
 meta/lib/oeqa/selftest/cases/pkgdata.py            |   73 +-
 meta/lib/oeqa/selftest/cases/prservice.py          |   19 +-
 meta/lib/oeqa/selftest/cases/recipetool.py         |  105 +-
 meta/lib/oeqa/selftest/cases/runqemu.py            |    7 +-
 meta/lib/oeqa/selftest/cases/runtime_test.py       |  225 +----
 .../lib/oeqa/selftest/cases/runtime_test_export.py |  104 ++
 .../oeqa/selftest/cases/runtime_test_postinsts.py  |  114 +++
 meta/lib/oeqa/selftest/cases/signing.py            |   40 +-
 meta/lib/oeqa/selftest/cases/sstate.py             |    5 +-
 meta/lib/oeqa/selftest/cases/sstatetests.py        |   51 +-
 meta/lib/oeqa/selftest/context.py                  |  137 ++-
 scripts/lib/argparse_oe.py                         |    7 +
 41 files changed, 1997 insertions(+), 1552 deletions(-)
 create mode 100644 meta/lib/oeqa/selftest/cases/devtool_deploy.py
 create mode 100644 meta/lib/oeqa/selftest/cases/devtool_end.py
 create mode 100644 meta/lib/oeqa/selftest/cases/imagefeatures_boot.py
 create mode 100644 meta/lib/oeqa/selftest/cases/runtime_test_export.py
 create mode 100644 meta/lib/oeqa/selftest/cases/runtime_test_postinsts.py

-- 
2.11.0



             reply	other threads:[~2017-07-12 19:36 UTC|newest]

Thread overview: 35+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-07-12 19:36 Aníbal Limón [this message]
2017-07-12 19:36 ` [PATCHv2 01/29] oeqa/core/loader: Switch method definition for _make_failed_test Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 02/29] oeqa/selftest/{context, case}: Handle KeyboardInterrupt/SIGINT and SIGTERM Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 03/29] selftest/cases/package: Call parent setUpClass method Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 04/29] bb/tinfoil: run_command handle busy status in bitbake server Aníbal Limón
2017-07-13 15:20   ` Christopher Larson
2017-07-13 15:32     ` Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 05/29] oe/copy_buildsystem: check_sstate_task_list also pop BBPATH from env Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 06/29] oeqa/core/threaded: Enable support to use the main thread Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 07/29] oeqa/core/threaded: Add support to run into a thread at end of execution Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 08/29] oeqa/core/threaded: logSummary add skipped tests info Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 09/29] oeqa/core/tests: Update test_loader threaded to cover main thread usage Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 10/29] oeqa/selftest/{case, context}: Add builddir by test class and context Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 11/29] oeqa/selftest/case: Add wrappers to utils.commands modules Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 12/29] oeqa/selftest/case: Creates meta-selftest layer per class Aníbal Limón
2017-07-12 19:36 ` [PATCHv2 13/29] oeqa/selftest/case: tearDown extra commands print what actually fails Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 14/29] oeqa/selftest/case: Support bitbake memres mode in per build directory Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 15/29] oeqa/selftest/cases: Use testlayer_path instead of call get_test_layer() Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 16/29] oeqa/selftest/cases: Use builddir from class instead of get from environment Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 17/29] oeqa/selftest/cases: Use wrapper methods from OESelfTestCase class Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 18/29] oeqa/selftest/cases: imagefeatures enable threaded runs Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 19/29] oeqa/selftest/cases: runqemu " Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 20/29] oeqa/selftest/cases: runtime " Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 21/29] oeqa/selftest/cases: eSDK " Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 22/29] oeqa/selftest/cases: devtool " Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 23/29] oeqa/selftest/cases: recipetool enable for " Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 24/29] oeqa/selftest/cases: Move devtool deploy test case to own module Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 25/29] selftest/cases/devtool{, end}: Move update/finish_modify tests to its " Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 26/29] seltest/cases/devtool: Build dbus on test_devtool_add_git_local Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 27/29] argparse_oe: Add int_positive type Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 28/29] oeqa/selftest/context: Enable support for threaded runs Aníbal Limón
2017-07-12 19:37 ` [PATCHv2 29/29] oeqa/selftest/cases: systemd_boot enable " Aníbal Limón
2017-07-12 20:01 ` ✗ patchtest: failure for oeqa core and oe-selftest threaded enablement (rev2) Patchwork
2017-07-12 21:05   ` Leonardo Sandoval
2017-07-13 16:14 ` [PATCHv2 00/29] oeqa core and oe-selftest threaded enablement Aníbal Limón

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=cover.1499887935.git.anibal.limon@linux.intel.com \
    --to=anibal.limon@linux.intel.com \
    --cc=joshua.g.lock@intel.com \
    --cc=openembedded-core@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox