From: Peter Kjellerstedt <peter.kjellerstedt@axis.com>
To: "OE Core (openembedded-core@lists.openembedded.org)"
<openembedded-core@lists.openembedded.org>
Subject: Oddness regarding file locks in package.bbclass
Date: Tue, 3 Oct 2017 18:17:20 +0000 [thread overview]
Message-ID: <b720c2022a0a49b08ea3159ef3fdf083@XBOX02.axis.com> (raw)
I just stumbled upon something odd in package.bbclass. In commit
ede381d5 from January 2011 (the code hasn't changed since), the
use of the ${PACKAGELOCK} lock file was changed to shared to
improve parallelism. However, when looking at the actual change
it becomes confusing. I have included it below for reference.
> commit ede381d56b180b384fdad98d445e5430819cfade
> Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> Date: Wed Jan 19 11:04:15 2011 +0000
>
> package.bbclass: Take a shared lock when reading to improve do_package parallelism
>
> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
>
> diff --git a/meta/classes/package.bbclass b/meta/classes/package.bbclass
> index d39c694de5..8e7fa26f72 100644
> --- a/meta/classes/package.bbclass
> +++ b/meta/classes/package.bbclass
> @@ -497,7 +497,8 @@ python emit_pkgdata() {
> pkgdest = bb.data.getVar('PKGDEST', d, 1)
> pkgdatadir = bb.data.getVar('PKGDESTWORK', d, True)
>
> - lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d))
> + # Take shared lock since we're only reading, not writing
> + lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d), True)
Here the lock is changed to shared as per the commit message.
>
> data_file = pkgdatadir + bb.data.expand("/${PN}" , d)
> f = open(data_file, 'w')
> @@ -649,6 +650,7 @@ python package_do_shlibs() {
> shlibs_dir = bb.data.getVar('SHLIBSDIR', d, True)
> shlibswork_dir = bb.data.getVar('SHLIBSWORKDIR', d, True)
>
> + # Take shared lock since we're only reading, not writing
> lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d))
Here, however, it is not changed, even though a comment is added to
say that it is. Was this intentional, or just an oversight?
>
> def linux_so(root, path, file):
> @@ -878,6 +880,7 @@ python package_do_pkgconfig () {
> if hdr == 'Requires':
> pkgconfig_needed[pkg] += exp.replace(',', ' ').split()
>
> + # Take shared lock since we're only reading, not writing
> lf = bb.utils.lockfile(bb.data.expand("${PACKAGELOCK}", d))
Here again a comment is added, but the code is not changed to match.
>
> for pkg in packages.split():
Also, what is the ${PACKAGELOCK} lock file actually protecting? With
the exception of the two questionable cases above, I cannot see that
the lock is taken privately anywhere else. And since it looks as the
code in package_do_shlibs() and package_do_pkgconfig() is not what
needs protection (based on the added comments above), what is?
//Peter
next reply other threads:[~2017-10-03 18:18 UTC|newest]
Thread overview: 4+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-10-03 18:17 Peter Kjellerstedt [this message]
2017-10-04 15:10 ` Oddness regarding file locks in package.bbclass Burton, Ross
2018-03-23 15:05 ` Trevor Woerner
2018-04-19 22:03 ` Richard Purdie
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=b720c2022a0a49b08ea3159ef3fdf083@XBOX02.axis.com \
--to=peter.kjellerstedt@axis.com \
--cc=openembedded-core@lists.openembedded.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox