All of lore.kernel.org
 help / color / mirror / Atom feed
From: Joshua Watt <jpewhacker@gmail.com>
To: bitbake-devel@lists.openembedded.org
Cc: docs@lists.yoctoproject.org
Subject: [PATCH 00/15] Add support for python structured logging
Date: Mon,  9 Mar 2020 11:33:38 -0500	[thread overview]
Message-ID: <20200309163353.15362-1-JPEWhacker@gmail.com> (raw)

Adds support for users to provide configuration for Python structured
logging in bitbake. This gives a high degree of flexibility to the way
that logs are capture and displayed, so users can generate very targeted
logging if desired. The initial use case for this is to maintain the
high level of hash equivalence logging on the Yocto autobuilders, while
reducing the noise for most other users.

I've added documentation updates for the new BB_LOGCONFIG variable, but
it probably needs some grooming.

Joshua Watt (15):
  bitbake: lib/bb/msg.py: Convert default domains to a dictionary
  bitbake: knotty: Handle logging messages with specific logger
  bitbake: lib/bb/msg.py: Use log level instead of debug count
  bitbake: lib/bb/msg.py: Add repr for BBLogFormatter
  bitbake: knotty: Add commented logging_tree code
  bitbake: lib/bb/msg.py: Add filter utilities
  bitbake: lib/bb/msg.py: Remove unused filters
  bitbake: lib/bb/msg.py: Add helper to set logging config
  bitbake: knotty: Remove dependency on format variable
  bitbake: knotty: Setup logs with config helper
  bitbake: worker: Remove unnecessary addDefaultLogFilter
  bitbake: Log hash equivalence with a different logger
  bitbake: Add autobuilder logging configuration
  bitbake: Lower hash equivalence logging
  bitbake: doc: Add documentation for BB_LOGCONFIG

 bitbake/bin/bitbake-worker                    |   3 +-
 bitbake/contrib/autobuilderlog.json           |  27 +++
 .../bitbake-user-manual-execution.xml         |  97 ++++++++++
 .../bitbake-user-manual-ref-variables.xml     |  11 ++
 bitbake/lib/bb/__init__.py                    |   7 +-
 bitbake/lib/bb/msg.py                         | 172 +++++++++++++----
 bitbake/lib/bb/runqueue.py                    |  13 +-
 bitbake/lib/bb/siggen.py                      |  17 +-
 bitbake/lib/bb/tinfoil.py                     |   4 +-
 bitbake/lib/bb/ui/knotty.py                   | 173 ++++++++++++------
 10 files changed, 419 insertions(+), 105 deletions(-)
 create mode 100644 bitbake/contrib/autobuilderlog.json

-- 
2.17.1



WARNING: multiple messages have this Message-ID (diff)
From: "Joshua Watt" <JPEWhacker@gmail.com>
To: bitbake-devel@lists.openembedded.org
Cc: docs@lists.yoctoproject.org, Joshua Watt <JPEWhacker@gmail.com>
Subject: [bitbake-devel][PATCH 00/15] Add support for python structured logging
Date: Mon,  9 Mar 2020 11:33:38 -0500	[thread overview]
Message-ID: <20200309163353.15362-1-JPEWhacker@gmail.com> (raw)

Adds support for users to provide configuration for Python structured
logging in bitbake. This gives a high degree of flexibility to the way
that logs are capture and displayed, so users can generate very targeted
logging if desired. The initial use case for this is to maintain the
high level of hash equivalence logging on the Yocto autobuilders, while
reducing the noise for most other users.

I've added documentation updates for the new BB_LOGCONFIG variable, but
it probably needs some grooming.

Joshua Watt (15):
  bitbake: lib/bb/msg.py: Convert default domains to a dictionary
  bitbake: knotty: Handle logging messages with specific logger
  bitbake: lib/bb/msg.py: Use log level instead of debug count
  bitbake: lib/bb/msg.py: Add repr for BBLogFormatter
  bitbake: knotty: Add commented logging_tree code
  bitbake: lib/bb/msg.py: Add filter utilities
  bitbake: lib/bb/msg.py: Remove unused filters
  bitbake: lib/bb/msg.py: Add helper to set logging config
  bitbake: knotty: Remove dependency on format variable
  bitbake: knotty: Setup logs with config helper
  bitbake: worker: Remove unnecessary addDefaultLogFilter
  bitbake: Log hash equivalence with a different logger
  bitbake: Add autobuilder logging configuration
  bitbake: Lower hash equivalence logging
  bitbake: doc: Add documentation for BB_LOGCONFIG

 bitbake/bin/bitbake-worker                    |   3 +-
 bitbake/contrib/autobuilderlog.json           |  27 +++
 .../bitbake-user-manual-execution.xml         |  97 ++++++++++
 .../bitbake-user-manual-ref-variables.xml     |  11 ++
 bitbake/lib/bb/__init__.py                    |   7 +-
 bitbake/lib/bb/msg.py                         | 172 +++++++++++++----
 bitbake/lib/bb/runqueue.py                    |  13 +-
 bitbake/lib/bb/siggen.py                      |  17 +-
 bitbake/lib/bb/tinfoil.py                     |   4 +-
 bitbake/lib/bb/ui/knotty.py                   | 173 ++++++++++++------
 10 files changed, 419 insertions(+), 105 deletions(-)
 create mode 100644 bitbake/contrib/autobuilderlog.json

-- 
2.17.1


             reply	other threads:[~2020-03-09 16:33 UTC|newest]

Thread overview: 35+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-03-09 16:33 Joshua Watt [this message]
2020-03-09 16:33 ` [bitbake-devel][PATCH 00/15] Add support for python structured logging Joshua Watt
2020-03-09 16:33 ` [PATCH 01/15] bitbake: lib/bb/msg.py: Convert default domains to a dictionary Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 02/15] bitbake: knotty: Handle logging messages with specific logger Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 03/15] bitbake: lib/bb/msg.py: Use log level instead of debug count Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 04/15] bitbake: lib/bb/msg.py: Add repr for BBLogFormatter Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 05/15] bitbake: knotty: Add commented logging_tree code Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 06/15] bitbake: lib/bb/msg.py: Add filter utilities Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 07/15] bitbake: lib/bb/msg.py: Remove unused filters Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 08/15] bitbake: lib/bb/msg.py: Add helper to set logging config Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 09/15] bitbake: knotty: Remove dependency on format variable Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 10/15] bitbake: knotty: Setup logs with config helper Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 11/15] bitbake: worker: Remove unnecessary addDefaultLogFilter Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 12/15] bitbake: Log hash equivalence with a different logger Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 13/15] bitbake: Add autobuilder logging configuration Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 14/15] bitbake: Lower hash equivalence logging Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-09 16:33 ` [PATCH 15/15] bitbake-user-manual: Add documentation for BB_LOGCONFIG Joshua Watt
2020-03-09 16:33   ` [bitbake-devel][PATCH " Joshua Watt
2020-03-12 23:50   ` [docs] [PATCH " Rich Persaud
2020-03-13  1:42     ` Joshua Watt
2020-03-13  1:42       ` [docs] [bitbake-devel][PATCH " Joshua Watt

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20200309163353.15362-1-JPEWhacker@gmail.com \
    --to=jpewhacker@gmail.com \
    --cc=bitbake-devel@lists.openembedded.org \
    --cc=docs@lists.yoctoproject.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.