From: "Urs Fässler" <urs.fassler@bbv.ch>
To: bitbake-devel@lists.openembedded.org
Subject: Issue with bitbake fetch/unpack when using MIRRORS rewrite
Date: Tue, 17 Jul 2018 13:15:53 +0200 [thread overview]
Message-ID: <1531826153.2962.36.camel@bbv.ch> (raw)
Hi,
I investigated the issue that the unpack step fails when using mirror
rewrite rules.
The root of the problem is, that the download step uses the
mirrored url to create the local filename while the unpack step uses
the url from the recipe to create the local filename.
As I understand the code, the link between the filename from
download and the filename from unpack is missing. It seems to work
because they are usually the same.
I tried both solutions proposed by Richard: Using symlinks and the
recipe-url.
The symlink solution is nice since it follows the same methods as for
git clones. Unfortunately, it is not practical for us. We like to store
the tarballs on a SMB share or S3 storage. Both do not support
symlinks.
The recipe-url naming method is nice since the tarball is named after
the url as it is written in the recipe. This is easy understandable.
But unfortunately this method breaks the test
"FetcherNetworkTest.test_gitfetch_premirror", which tests the
following: when 2 different recipe-urls point to the same mirrored-url,
the repository is cloned only once.
Now the question is which solution we should implement. For us, it is
the second one (tarball naming after recipe-url). It comes with the
downside that the one mentioned test fails and has to be removed. In a
real scenario this results in downloading a repository twice and having
2 tarballs with the same content. But I expect this to be unlikely in a
real world scenario.
A third solution may be that we add a link between the download and
unpack task. But this would be the most intrusive solution for Bitbake.
Thanks,
Urs
next reply other threads:[~2018-07-17 21:50 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-07-17 11:15 Urs Fässler [this message]
2018-07-17 11:24 ` Issue with bitbake fetch/unpack when using MIRRORS rewrite richard.purdie
2018-07-17 13:39 ` Urs Fässler
2018-07-17 14:00 ` richard.purdie
2018-07-18 12:38 ` Urs Fässler
-- strict thread matches above, loose matches on Subject: below --
2018-03-09 9:40 Bach, Pascal
2018-03-11 13:36 ` Richard Purdie
2018-07-02 12:29 ` Urs Fässler
2018-07-03 13:59 ` Urs Fässler
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1531826153.2962.36.camel@bbv.ch \
--to=urs.fassler@bbv.ch \
--cc=bitbake-devel@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.