From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id 50400E00BF4; Mon, 4 Apr 2016 02:47:20 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-5.7 required=5.0 tests=BAYES_00,NUMERIC_HTTP_ADDR, RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -5.0 RCVD_IN_DNSWL_HI RBL: Sender listed at http://www.dnswl.org/, high * trust * [192.55.52.88 listed in list.dnswl.org] * 1.2 NUMERIC_HTTP_ADDR URI: Uses a numeric IP address in URL * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id DC54FE00B6F for ; Mon, 4 Apr 2016 02:47:17 -0700 (PDT) Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by fmsmga101.fm.intel.com with ESMTP; 04 Apr 2016 02:47:10 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.24,439,1455004800"; d="scan'208";a="680445844" Received: from linux.intel.com ([10.23.219.25]) by FMSMGA003.fm.intel.com with ESMTP; 04 Apr 2016 02:47:10 -0700 Received: from vmed.fi.intel.com (vmed.fi.intel.com [10.237.72.51]) by linux.intel.com (Postfix) with ESMTP id E9BBC6A4006 for ; Mon, 4 Apr 2016 03:34:50 -0700 (PDT) From: Ed Bartosh To: toaster@yoctoproject.org Date: Mon, 4 Apr 2016 10:26:31 +0300 Message-Id: X-Mailer: git-send-email 2.1.4 Subject: [PATCH v8 00/45] per project build directory + build cancel + DL_DIR/SSTATE_DIR X-BeenThere: toaster@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Web based interface for BitBake List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Apr 2016 09:47:20 -0000 Hi, Default build directory is not going to be used for project builds anymore. It can be used only for command line builds. Toaster will use build-toaster- directories for project builds. The patchset also contains implementation of build cancelation(#6787) and setting of DL_DIR and SSTATE_DIR project variables. This work was done by Sujith and Michael. This patchset fixes the following bugs: 7880 2.1M3 Medium+/Normal: Toaster uses the same /tmp dir across releases 9058 2.1 Medium/Normal: Bad project MACHINE setting in conf/toaster.conf causes command line builds to fail 8958 2.1M3 Medium/Normal: Toaster does not build with the Jethro release 6787 2.1 Medium/Enhancement: Cancelling builds at any point in the build process 8422 2.1 Medium/Enhancement: we currently don't allow setting of sstate_dir or dl_dir This is how to test this: - run toaster - run command line build: build zlib - check if it's shown in Toaster UI - create project for Yocto master - trigger project build from UI - wait until it succeeds - create project for Jethro - check that DL_DIR and SSTATE_DIR variables point to the same location for both projects - trigger project build from UI - wait until it succeds - check that 2 build directories build-toaster- exist and contain correct conf/toaster.conf and conf/bblayers.conf - trigger any build from UI again and try to cancel it Changes in v2: stop bitbake server after the build Changes in v3: fixed '/bin/sh: 1: source: not found' dash issue used project id in build directory name added 'INHERIT+='toaster buildhistory' to conf/local.conf on toaster start Changes in v4: fixed builds on Ubuntu caused by dash being default shell Changes in v5: fixed nasty bug in toasterui causing it to stuck in event loop Changes in v6: added fix for 6787 build cancelation patchset added fix for 8422 (DL_DIR and SSTATE_DIR) patchset run bitbake client from sourcedir/bitbake/bin fixed empty image data fixed couple of crashes in buildinfohelper code rebased on top of toaster-next@March 23rd 10:20 GMT Changes in v7: fixed building for non-poky setup fixed absent image package info Changes in v8: fixed wrong status of cancelled build reorganized migrations rebased on top of toaster-next@Apr 4th 10:42 GMT The following changes since commit 7f90fd65ec61a60a9946deffb8f37ea1e78422ef: toaster: orm better detect requires during CustomImageRecipe generation (2016-04-01 14:52:01 +0100) are available in the git repository at: git://git.yoctoproject.org/poky-contrib ed/toaster/project-build-dir-cancel-dldir_sstatedir http://git.yoctoproject.org/cgit.cgi/poky-contrib/log/?h=ed/toaster/project-build-dir-cancel-dldir_sstatedir Ed Bartosh (27): toaster: don't start bitbake server toaster: get rid of noui option toaster: set BITBAKE_UI environment variable toasterui: add brbe parameter to buildinfohelper uievent: improve BBUIEventQueue code buildinfohelper: improve handling of providermap toasterui: fix brbe reporting toaster: remove startBBServer API toaster: remove release API toaster: add brbe parameter to triggerBuild toaster: modified setLayers API toaster: reimplement triggerBuild toaster: add new parameter to _shellcmd toaster: stop bitbake server after the build toaster: update conf/local.conf toaster: fix jethro build toaster: use bash explicitly toasterui: shutdown on BuildCompleted event toaster: fix conflicting migrations toaster: use empty token toaster: add DL_DIR and SSTATE_DIR to oe toasterconf toaster: export BBBASEDIR variable toaster: get bitbake location from BBBASEDIR buildinfohelper: fix KeyError toasterui: fix warning 'Unknown event' toasterui: update build in internal state toaster: reorder migrations Elliot Smith (1): toasterui: detect build run start correctly on Jethro Michael Wood (10): toaster: buildinfohelper Create target list for all types of build toaster: Move xhr calls for starting and stopping builds toaster: xhr Update the implementation of the build cancellation request toaster: libtoaster Update implementation of startABuild and cancelABuild toaster: bldcontrol models Add a cancelling state the BuildRequest buildinfohelper: Add handler for cancelling a build toaster: mrb_section template Add build cancel button toaster: models Exclude the CANCELLED builds from get_number_of_builds toaster: runbuilds Make runbuilds aware of the build CANCELLED state toaster: runbuilds Clean up runbuilds Sujith H (7): toaster: bldcontrol Add forceShutDown function to BitbakeController toaster: update BuildEnvironmentController and BitbakeController toaster: models Add cancelled state to build outcome toaster: tables BuildsTable exclude cancelled builds toaster: add DL_DIR and SSTATE_DIR to poky toasterconf toaster: update view to support DL_DIR and SSTATE_DIR toaster: update projectconf.html for DL_DIR and SSTATE_DIR bitbake/bin/toaster | 82 ++--------- bitbake/lib/bb/ui/buildinfohelper.py | 69 +++++---- bitbake/lib/bb/ui/toasterui.py | 54 ++++--- bitbake/lib/bb/ui/uievent.py | 10 +- bitbake/lib/toaster/bldcontrol/bbcontroller.py | 62 +------- .../toaster/bldcontrol/localhostbecontroller.py | 152 ++++++++++---------- .../bldcontrol/management/commands/runbuilds.py | 109 +++++++++----- .../migrations/0002_add_cancelling_state.py | 19 +++ ...20160120_1250.py => 0003_auto_20160120_1250.py} | 2 +- .../toaster/bldcontrol/migrations/0004_merge.py | 14 ++ bitbake/lib/toaster/bldcontrol/models.py | 27 +++- .../orm/migrations/0007_add_cancelled_state.py | 20 +++ bitbake/lib/toaster/orm/migrations/0008_merge.py | 14 ++ bitbake/lib/toaster/orm/models.py | 12 +- bitbake/lib/toaster/toastergui/api.py | 110 ++++++++++++++ .../toaster/toastergui/static/js/customrecipe.js | 4 +- .../lib/toaster/toastergui/static/js/layerBtn.js | 3 +- .../lib/toaster/toastergui/static/js/libtoaster.js | 41 ++++-- .../lib/toaster/toastergui/static/js/mrbsection.js | 95 ++++++++++++ .../toaster/toastergui/static/js/projectpage.js | 4 +- .../toaster/toastergui/static/js/projecttopbar.js | 6 +- .../toaster/toastergui/static/js/recipedetails.js | 4 +- bitbake/lib/toaster/toastergui/tables.py | 48 +------ bitbake/lib/toaster/toastergui/templates/base.html | 1 + .../toaster/toastergui/templates/mrb_section.html | 148 +++++++------------ .../toaster/toastergui/templates/projectconf.html | 160 ++++++++++++++++++++- bitbake/lib/toaster/toastergui/urls.py | 5 + bitbake/lib/toaster/toastergui/views.py | 40 +++++- meta-poky/conf/toasterconf.json | 4 +- meta/conf/toasterconf.json | 4 +- 30 files changed, 860 insertions(+), 463 deletions(-) create mode 100644 bitbake/lib/toaster/bldcontrol/migrations/0002_add_cancelling_state.py rename bitbake/lib/toaster/bldcontrol/migrations/{0002_auto_20160120_1250.py => 0003_auto_20160120_1250.py} (87%) create mode 100644 bitbake/lib/toaster/bldcontrol/migrations/0004_merge.py create mode 100644 bitbake/lib/toaster/orm/migrations/0007_add_cancelled_state.py create mode 100644 bitbake/lib/toaster/orm/migrations/0008_merge.py create mode 100644 bitbake/lib/toaster/toastergui/api.py create mode 100644 bitbake/lib/toaster/toastergui/static/js/mrbsection.js -- Regards, Ed