From: Richard Purdie <richard.purdie@linuxfoundation.org>
To: Bruce Ashfield <bruce.ashfield@gmail.com>,
Stefan Herbrechtsmeier
<stefan.herbrechtsmeier-oss@weidmueller.com>
Cc: openembedded-core@lists.openembedded.org,
Stefan Herbrechtsmeier <stefan.herbrechtsmeier@weidmueller.com>
Subject: Re: [OE-core] [RFC PATCH 21/30] python3-bcrypt: mirgrate to vendor cargo class
Date: Wed, 12 Feb 2025 17:52:07 +0000 [thread overview]
Message-ID: <1b97f3574bc89e5d941f01156b3ff529abaaf59b.camel@linuxfoundation.org> (raw)
In-Reply-To: <CADkTA4MtM9ZbakC-u0Qk8bQjcOk6uYuYYhFagWR3fmNqC7gWrw@mail.gmail.com>
On Wed, 2025-02-12 at 12:45 -0500, Bruce Ashfield wrote:
> On Wed, Feb 12, 2025 at 12:24 PM Stefan Herbrechtsmeier
> <stefan.herbrechtsmeier-oss@weidmueller.com> wrote:
>
> >
> > >
> > > >
> > > > As a compromise we could add a new feature to generate .inc
> > > > cache files before the main bitbake run. This would eliminate
> > > > the manual update run and the commit noise as well as special
> > > > fetch, unpack and patch task.
> > > >
> > > Can you elaborate on what you mean by before the main bitbake run
> > > ? Would it be still under a single bitbake invokation or would it
> > > be multiple runs (I support multiple runs, so don't take that as
> > > a leading question).
> > >
> > I can't answer this questions and need Richard guidance to
> > implement such a feature. I would assume that bitbake already track
> > file changes and can update its state. The behavior should be
> > similar to a change in the .inc file. Bitbake will detect that a
> > "include_cache" file is missing and run an update_cache task on the
> > recipe. Afterwards bitbake detect a file change on the
> > "include_cache" file and parse it. We need a possibility to mark
> > patches which shouldn't be applied if the "include_cache" file is
> > missing because the dependencies are missing. We need to run the
> > fetch, unpack and patch task before the update_cache task to
> > generate the .inc file.
> >
> Aha. Maybe Richard will comment later. I was thinking more about
> something that was in two distinct phases, but with some more
> thinking and explanation, maybe this is workable as well.
We don't have anything in bitbake which could support this currently.
We parse once, store a subset of the data and then have all the
information bitbake needs. There is no second parse something else
later in the task graph concept or support, or support for "generate
this file if missing", particularly if generating that file would
require other tasks to run.
That said, I am wondering if we need to do something differently here,
it is obviously just going to complicate things a lot if we need new
concepts and API at that level in bitbake.
Cheers,
Richard
next prev parent reply other threads:[~2025-02-12 17:52 UTC|newest]
Thread overview: 73+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-02-11 15:00 [RFC PATCH 00/30] Add vendor support for go, npm and rust Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 01/30] classes: create-spdx-2.2: use expanded FetchData for downloaded packages Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 02/30] lib: spdx30_tasks: use expanded FetchData for download files Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 03/30] classes: create-spdx-2.2: use name and version for download dependencies Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 04/30] lib: bb: fetch2: add support to unpack .crate files Stefan Herbrechtsmeier
2025-02-11 21:22 ` [OE-core] " Richard Purdie
2025-02-11 15:00 ` [RFC PATCH 05/30] lib: oe: add vendor module Stefan Herbrechtsmeier
2025-02-11 21:31 ` [OE-core] " Richard Purdie
2025-02-12 9:27 ` Stefan Herbrechtsmeier
2025-02-12 9:38 ` Richard Purdie
2025-02-12 12:21 ` Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 06/30] lib: oe: vendor: add cargo support Stefan Herbrechtsmeier
2025-02-12 10:32 ` [OE-core] " Alexander Kanavin
2025-02-12 12:45 ` Frédéric Martinsons
2025-02-12 16:29 ` Stefan Herbrechtsmeier
2025-02-12 17:48 ` Frédéric Martinsons
2025-02-13 8:53 ` Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 07/30] lib: oe: vendor: add go support Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 08/30] lib: oe: vendor: add npm support Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 09/30] oeqa: oelib: add vendor tests Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 10/30] conf: bitbake: add SRC_URI_FILES variable Stefan Herbrechtsmeier
2025-02-11 16:22 ` [bitbake-devel] " Peter Kjellerstedt
2025-02-12 8:55 ` Stefan Herbrechtsmeier
2025-02-12 9:49 ` [OE-core] " Alexander Kanavin
[not found] ` <18236D0FFBD06B89.28278@lists.openembedded.org>
2025-02-12 10:42 ` Alexander Kanavin
2025-02-11 19:06 ` Peter Kjellerstedt
2025-02-11 15:00 ` [RFC PATCH 11/30] classes: go: make source directory configurable Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 12/30] classes: go-mod: make class customizable Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 13/30] classes: add nodejs-arch class Stefan Herbrechtsmeier
2025-02-12 10:37 ` [OE-core] " Alexander Kanavin
2025-02-11 15:00 ` [RFC PATCH 14/30] classes: base: add get_src_uris and unpack_src_uris functions Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 15/30] classes: add early fetch, unpack and patch support Stefan Herbrechtsmeier
2025-02-11 22:27 ` [OE-core] " Richard Purdie
2025-02-12 12:21 ` Stefan Herbrechtsmeier
2025-02-11 22:32 ` Bruce Ashfield
2025-02-12 12:42 ` Stefan Herbrechtsmeier
2025-02-12 13:55 ` Bruce Ashfield
2025-02-12 14:40 ` Stefan Herbrechtsmeier
2025-02-12 11:08 ` Alexander Kanavin
2025-02-12 16:23 ` Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 16/30] classes: add vendor class Stefan Herbrechtsmeier
2025-02-11 19:17 ` [OE-core] " Peter Kjellerstedt
2025-02-11 15:00 ` [RFC PATCH 17/30] classes: add vendor class for cargo Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 18/30] classes: add vendor class for go Stefan Herbrechtsmeier
2025-02-11 22:59 ` [OE-core] " Bruce Ashfield
2025-02-12 15:23 ` Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 19/30] classes: add vendor class for npm Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 20/30] classes: add vendor_npm_build class Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 21/30] python3-bcrypt: mirgrate to vendor cargo class Stefan Herbrechtsmeier
2025-02-11 21:46 ` [OE-core] " Richard Purdie
2025-02-12 14:36 ` Stefan Herbrechtsmeier
2025-02-12 15:06 ` Richard Purdie
2025-02-12 17:27 ` Stefan Herbrechtsmeier
2025-02-12 15:07 ` Bruce Ashfield
2025-02-12 17:24 ` Stefan Herbrechtsmeier
2025-02-12 17:45 ` Bruce Ashfield
2025-02-12 17:52 ` Richard Purdie [this message]
2025-02-13 12:45 ` Stefan Herbrechtsmeier
2025-02-13 17:07 ` Bruce Ashfield
2025-02-11 15:00 ` [RFC PATCH 22/30] python3-cryptography: " Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 23/30] python3-maturin: " Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 24/30] python3-rpds-py: " Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 25/30] librsvg: " Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 26/30] librsvg: update dependecies to fix RUSTSEC-2024-0421 Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 27/30] [DO NOT MERGE] recipes: add crucible go demo Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 28/30] [DO NOT MERGE] recipes: add node-red npm demo Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 29/30] [DO NOT MERGE] recipes: add nucleoidai " Stefan Herbrechtsmeier
2025-02-11 15:00 ` [RFC PATCH 30/30] [DO NOT MERGE] classes: spdx: use version 2.2 Stefan Herbrechtsmeier
2025-02-11 23:14 ` [bitbake-devel] [RFC PATCH 00/30] Add vendor support for go, npm and rust Bruce Ashfield
2025-02-12 8:41 ` Stefan Herbrechtsmeier
2025-02-12 14:11 ` Bruce Ashfield
2025-02-13 8:36 ` Stefan Herbrechtsmeier
2025-02-13 17:01 ` Bruce Ashfield
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1b97f3574bc89e5d941f01156b3ff529abaaf59b.camel@linuxfoundation.org \
--to=richard.purdie@linuxfoundation.org \
--cc=bruce.ashfield@gmail.com \
--cc=openembedded-core@lists.openembedded.org \
--cc=stefan.herbrechtsmeier-oss@weidmueller.com \
--cc=stefan.herbrechtsmeier@weidmueller.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox