From: Ed Bartosh <ed.bartosh@linux.intel.com>
To: toaster@yoctoproject.org
Subject: [PATCH v8 00/45] per project build directory + build cancel + DL_DIR/SSTATE_DIR
Date: Mon, 4 Apr 2016 10:26:31 +0300 [thread overview]
Message-ID: <cover.1459754161.git.ed.bartosh@linux.intel.com> (raw)
Hi,
Default build directory is not going to be used for project builds anymore.
It can be used only for command line builds. Toaster will use build-toaster-<project id>
directories for project builds.
The patchset also contains implementation of build cancelation(#6787) and setting of
DL_DIR and SSTATE_DIR project variables. This work was done by Sujith and Michael.
This patchset fixes the following bugs:
7880 2.1M3 Medium+/Normal: Toaster uses the same /tmp dir across releases
9058 2.1 Medium/Normal: Bad project MACHINE setting in conf/toaster.conf causes command line builds to fail
8958 2.1M3 Medium/Normal: Toaster does not build with the Jethro release
6787 2.1 Medium/Enhancement: Cancelling builds at any point in the build process
8422 2.1 Medium/Enhancement: we currently don't allow setting of sstate_dir or dl_dir
This is how to test this:
- run toaster
- run command line build: build zlib
- check if it's shown in Toaster UI
- create project for Yocto master
- trigger project build from UI
- wait until it succeeds
- create project for Jethro
- check that DL_DIR and SSTATE_DIR variables point to the same location for both projects
- trigger project build from UI
- wait until it succeds
- check that 2 build directories build-toaster-<project id> exist and contain
correct conf/toaster.conf and conf/bblayers.conf
- trigger any build from UI again and try to cancel it
Changes in v2: stop bitbake server after the build
Changes in v3: fixed '/bin/sh: 1: source: not found' dash issue
used project id in build directory name
added 'INHERIT+='toaster buildhistory' to conf/local.conf on toaster start
Changes in v4: fixed builds on Ubuntu caused by dash being default shell
Changes in v5: fixed nasty bug in toasterui causing it to stuck in event loop
Changes in v6: added fix for 6787 build cancelation patchset
added fix for 8422 (DL_DIR and SSTATE_DIR) patchset
run bitbake client from sourcedir/bitbake/bin
fixed empty image data
fixed couple of crashes in buildinfohelper code
rebased on top of toaster-next@March 23rd 10:20 GMT
Changes in v7: fixed building for non-poky setup
fixed absent image package info
Changes in v8: fixed wrong status of cancelled build
reorganized migrations
rebased on top of toaster-next@Apr 4th 10:42 GMT
The following changes since commit 7f90fd65ec61a60a9946deffb8f37ea1e78422ef:
toaster: orm better detect requires during CustomImageRecipe generation (2016-04-01 14:52:01 +0100)
are available in the git repository at:
git://git.yoctoproject.org/poky-contrib ed/toaster/project-build-dir-cancel-dldir_sstatedir
http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=ed/toaster/project-build-dir-cancel-dldir_sstatedir
Ed Bartosh (27):
toaster: don't start bitbake server
toaster: get rid of noui option
toaster: set BITBAKE_UI environment variable
toasterui: add brbe parameter to buildinfohelper
uievent: improve BBUIEventQueue code
buildinfohelper: improve handling of providermap
toasterui: fix brbe reporting
toaster: remove startBBServer API
toaster: remove release API
toaster: add brbe parameter to triggerBuild
toaster: modified setLayers API
toaster: reimplement triggerBuild
toaster: add new parameter to _shellcmd
toaster: stop bitbake server after the build
toaster: update conf/local.conf
toaster: fix jethro build
toaster: use bash explicitly
toasterui: shutdown on BuildCompleted event
toaster: fix conflicting migrations
toaster: use empty token
toaster: add DL_DIR and SSTATE_DIR to oe toasterconf
toaster: export BBBASEDIR variable
toaster: get bitbake location from BBBASEDIR
buildinfohelper: fix KeyError
toasterui: fix warning 'Unknown event'
toasterui: update build in internal state
toaster: reorder migrations
Elliot Smith (1):
toasterui: detect build run start correctly on Jethro
Michael Wood (10):
toaster: buildinfohelper Create target list for all types of build
toaster: Move xhr calls for starting and stopping builds
toaster: xhr Update the implementation of the build cancellation
request
toaster: libtoaster Update implementation of startABuild and
cancelABuild
toaster: bldcontrol models Add a cancelling state the BuildRequest
buildinfohelper: Add handler for cancelling a build
toaster: mrb_section template Add build cancel button
toaster: models Exclude the CANCELLED builds from get_number_of_builds
toaster: runbuilds Make runbuilds aware of the build CANCELLED state
toaster: runbuilds Clean up runbuilds
Sujith H (7):
toaster: bldcontrol Add forceShutDown function to BitbakeController
toaster: update BuildEnvironmentController and BitbakeController
toaster: models Add cancelled state to build outcome
toaster: tables BuildsTable exclude cancelled builds
toaster: add DL_DIR and SSTATE_DIR to poky toasterconf
toaster: update view to support DL_DIR and SSTATE_DIR
toaster: update projectconf.html for DL_DIR and SSTATE_DIR
bitbake/bin/toaster | 82 ++---------
bitbake/lib/bb/ui/buildinfohelper.py | 69 +++++----
bitbake/lib/bb/ui/toasterui.py | 54 ++++---
bitbake/lib/bb/ui/uievent.py | 10 +-
bitbake/lib/toaster/bldcontrol/bbcontroller.py | 62 +-------
.../toaster/bldcontrol/localhostbecontroller.py | 152 ++++++++++----------
.../bldcontrol/management/commands/runbuilds.py | 109 +++++++++-----
.../migrations/0002_add_cancelling_state.py | 19 +++
...20160120_1250.py => 0003_auto_20160120_1250.py} | 2 +-
.../toaster/bldcontrol/migrations/0004_merge.py | 14 ++
bitbake/lib/toaster/bldcontrol/models.py | 27 +++-
.../orm/migrations/0007_add_cancelled_state.py | 20 +++
bitbake/lib/toaster/orm/migrations/0008_merge.py | 14 ++
bitbake/lib/toaster/orm/models.py | 12 +-
bitbake/lib/toaster/toastergui/api.py | 110 ++++++++++++++
.../toaster/toastergui/static/js/customrecipe.js | 4 +-
.../lib/toaster/toastergui/static/js/layerBtn.js | 3 +-
.../lib/toaster/toastergui/static/js/libtoaster.js | 41 ++++--
.../lib/toaster/toastergui/static/js/mrbsection.js | 95 ++++++++++++
.../toaster/toastergui/static/js/projectpage.js | 4 +-
.../toaster/toastergui/static/js/projecttopbar.js | 6 +-
.../toaster/toastergui/static/js/recipedetails.js | 4 +-
bitbake/lib/toaster/toastergui/tables.py | 48 +------
bitbake/lib/toaster/toastergui/templates/base.html | 1 +
.../toaster/toastergui/templates/mrb_section.html | 148 +++++++------------
.../toaster/toastergui/templates/projectconf.html | 160 ++++++++++++++++++++-
bitbake/lib/toaster/toastergui/urls.py | 5 +
bitbake/lib/toaster/toastergui/views.py | 40 +++++-
meta-poky/conf/toasterconf.json | 4 +-
meta/conf/toasterconf.json | 4 +-
30 files changed, 860 insertions(+), 463 deletions(-)
create mode 100644 bitbake/lib/toaster/bldcontrol/migrations/0002_add_cancelling_state.py
rename bitbake/lib/toaster/bldcontrol/migrations/{0002_auto_20160120_1250.py => 0003_auto_20160120_1250.py} (87%)
create mode 100644 bitbake/lib/toaster/bldcontrol/migrations/0004_merge.py
create mode 100644 bitbake/lib/toaster/orm/migrations/0007_add_cancelled_state.py
create mode 100644 bitbake/lib/toaster/orm/migrations/0008_merge.py
create mode 100644 bitbake/lib/toaster/toastergui/api.py
create mode 100644 bitbake/lib/toaster/toastergui/static/js/mrbsection.js
--
Regards,
Ed
next reply other threads:[~2016-04-04 9:47 UTC|newest]
Thread overview: 47+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-04-04 7:26 Ed Bartosh [this message]
2016-04-04 7:26 ` [PATCH v8 01/45] toaster: buildinfohelper Create target list for all types of build Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 02/45] toaster: don't start bitbake server Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 03/45] toaster: get rid of noui option Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 04/45] toaster: set BITBAKE_UI environment variable Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 05/45] toasterui: add brbe parameter to buildinfohelper Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 06/45] uievent: improve BBUIEventQueue code Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 07/45] buildinfohelper: improve handling of providermap Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 08/45] toasterui: fix brbe reporting Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 09/45] toaster: remove startBBServer API Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 10/45] toaster: remove release API Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 11/45] toaster: add brbe parameter to triggerBuild Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 12/45] toaster: modified setLayers API Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 13/45] toaster: reimplement triggerBuild Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 14/45] toaster: add new parameter to _shellcmd Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 15/45] toaster: stop bitbake server after the build Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 16/45] toaster: update conf/local.conf Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 17/45] toaster: fix jethro build Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 18/45] toaster: use bash explicitly Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 19/45] toasterui: shutdown on BuildCompleted event Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 20/45] toaster: bldcontrol Add forceShutDown function to BitbakeController Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 21/45] toaster: Move xhr calls for starting and stopping builds Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 22/45] toaster: xhr Update the implementation of the build cancellation request Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 23/45] toaster: libtoaster Update implementation of startABuild and cancelABuild Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 24/45] toaster: update BuildEnvironmentController and BitbakeController Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 25/45] toaster: models Add cancelled state to build outcome Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 26/45] toaster: bldcontrol models Add a cancelling state the BuildRequest Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 27/45] buildinfohelper: Add handler for cancelling a build Ed Bartosh
2016-04-04 7:26 ` [PATCH v8 28/45] toaster: tables BuildsTable exclude cancelled builds Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 29/45] toaster: mrb_section template Add build cancel button Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 30/45] toaster: models Exclude the CANCELLED builds from get_number_of_builds Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 31/45] toaster: runbuilds Make runbuilds aware of the build CANCELLED state Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 32/45] toaster: runbuilds Clean up runbuilds Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 33/45] toaster: fix conflicting migrations Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 34/45] toaster: use empty token Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 35/45] toaster: add DL_DIR and SSTATE_DIR to poky toasterconf Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 36/45] toaster: add DL_DIR and SSTATE_DIR to oe toasterconf Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 37/45] toaster: update view to support DL_DIR and SSTATE_DIR Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 38/45] toaster: update projectconf.html for " Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 39/45] toaster: export BBBASEDIR variable Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 40/45] toaster: get bitbake location from BBBASEDIR Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 41/45] toasterui: detect build run start correctly on Jethro Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 42/45] buildinfohelper: fix KeyError Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 43/45] toasterui: fix warning 'Unknown event' Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 44/45] toasterui: update build in internal state Ed Bartosh
2016-04-04 7:27 ` [PATCH v8 45/45] toaster: reorder migrations Ed Bartosh
2016-04-05 14:12 ` [PATCH v8 00/45] per project build directory + build cancel + DL_DIR/SSTATE_DIR Barros Pena, Belen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1459754161.git.ed.bartosh@linux.intel.com \
--to=ed.bartosh@linux.intel.com \
--cc=toaster@yoctoproject.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.