* [bitbake][kirkstone][2.0][PATCH 01/18] providers: use local variable for packages_dynamic pattern
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 02/18] tests/parse: Fix one test overwriting another Steve Sakoman
` (16 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Matt Madison <matt@madison.systems>
During parsing, Python raises
RuntimeError: dictionary changed size during iteration
in getRuntimeProviders, if you happen to have a recipe
with an explicit RDEPENDS on a dynamic package containing a '+'
character, such as 'gtk+3-locale-en'.
This is because we're using the modified pattern as the
key into the packages_dynamic dict to append to rproviders,
and since that key doesn't exist, the dict is getting modified
to add a new, empty, entry for it. So even without the runtime
error, we'd be generating an incorrect result.
Fix this by using a local variable for modifying the pattern
and using the original key to retrieve the value on a match.
Signed-off-by: Matt Madison <matt@madison.systems>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 07de375c3e57f17ab7b47569186f24ecd9896825)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/providers.py | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/lib/bb/providers.py b/lib/bb/providers.py
index 8c1c31a5..e11a4637 100644
--- a/lib/bb/providers.py
+++ b/lib/bb/providers.py
@@ -396,8 +396,8 @@ def getRuntimeProviders(dataCache, rdepend):
return rproviders
# Only search dynamic packages if we can't find anything in other variables
- for pattern in dataCache.packages_dynamic:
- pattern = pattern.replace(r'+', r"\+")
+ for pat_key in dataCache.packages_dynamic:
+ pattern = pat_key.replace(r'+', r"\+")
if pattern in regexp_cache:
regexp = regexp_cache[pattern]
else:
@@ -408,7 +408,7 @@ def getRuntimeProviders(dataCache, rdepend):
raise
regexp_cache[pattern] = regexp
if regexp.match(rdepend):
- rproviders += dataCache.packages_dynamic[pattern]
+ rproviders += dataCache.packages_dynamic[pat_key]
logger.debug("Assuming %s is a dynamic package, but it may not exist" % rdepend)
return rproviders
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 02/18] tests/parse: Fix one test overwriting another
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 01/18] providers: use local variable for packages_dynamic pattern Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 03/18] server/process: Drop unused import Steve Sakoman
` (15 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Fix an issue where two tests have the same name with one overwriting the
other.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit da812d938fd79e2cc7bdf355ccf5b0f9ead684c4)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/tests/parse.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/lib/bb/tests/parse.py b/lib/bb/tests/parse.py
index 4d17f82e..2898f9bb 100644
--- a/lib/bb/tests/parse.py
+++ b/lib/bb/tests/parse.py
@@ -119,7 +119,7 @@ EXTRA_OECONF:class-target = "b"
EXTRA_OECONF:append = " c"
"""
- def test_parse_overrides(self):
+ def test_parse_overrides2(self):
f = self.parsehelper(self.overridetest2)
d = bb.parse.handle(f.name, self.d)['']
d.appendVar("EXTRA_OECONF", " d")
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 03/18] server/process: Drop unused import
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 01/18] providers: use local variable for packages_dynamic pattern Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 02/18] tests/parse: Fix one test overwriting another Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 04/18] ui/buildinfohelper: " Steve Sakoman
` (14 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 543315e6463f15ca7ab2b4ef3e8ed41bb4207ccf)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/server/process.py | 1 -
1 file changed, 1 deletion(-)
diff --git a/lib/bb/server/process.py b/lib/bb/server/process.py
index 19ef8398..613956f3 100644
--- a/lib/bb/server/process.py
+++ b/lib/bb/server/process.py
@@ -20,7 +20,6 @@ import os
import sys
import time
import select
-import signal
import socket
import subprocess
import errno
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 04/18] ui/buildinfohelper: Drop unused import
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (2 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 03/18] server/process: Drop unused import Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 05/18] cooker: Drop unused loop Steve Sakoman
` (13 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit aca0ff85109f4b0f3c201c02c3f59cad7ee2e787)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/ui/buildinfohelper.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/lib/bb/ui/buildinfohelper.py b/lib/bb/ui/buildinfohelper.py
index 0761f73b..9c4215f9 100644
--- a/lib/bb/ui/buildinfohelper.py
+++ b/lib/bb/ui/buildinfohelper.py
@@ -45,7 +45,7 @@ from pprint import pformat
import logging
from datetime import datetime, timedelta
-from django.db import transaction, connection
+from django.db import transaction
# pylint: disable=invalid-name
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 05/18] cooker: Drop unused loop
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (3 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 04/18] ui/buildinfohelper: " Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 06/18] msg: Drop unused local variable Steve Sakoman
` (12 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 1c811ad6f10560e7a7fb6830cf83707551ba04bd)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/cooker.py | 25 ++++++++++++-------------
1 file changed, 12 insertions(+), 13 deletions(-)
diff --git a/lib/bb/cooker.py b/lib/bb/cooker.py
index 08593d11..6da9291f 100644
--- a/lib/bb/cooker.py
+++ b/lib/bb/cooker.py
@@ -744,19 +744,18 @@ class BBCooker:
taskdata[mc].add_unresolved(localdata[mc], self.recipecaches[mc])
mcdeps |= set(taskdata[mc].get_mcdepends())
new = False
- for mc in self.multiconfigs:
- for k in mcdeps:
- if k in seen:
- continue
- l = k.split(':')
- depmc = l[2]
- if depmc not in self.multiconfigs:
- bb.fatal("Multiconfig dependency %s depends on nonexistent multiconfig configuration named configuration %s" % (k,depmc))
- else:
- logger.debug("Adding providers for multiconfig dependency %s" % l[3])
- taskdata[depmc].add_provider(localdata[depmc], self.recipecaches[depmc], l[3])
- seen.add(k)
- new = True
+ for k in mcdeps:
+ if k in seen:
+ continue
+ l = k.split(':')
+ depmc = l[2]
+ if depmc not in self.multiconfigs:
+ bb.fatal("Multiconfig dependency %s depends on nonexistent multiconfig configuration named configuration %s" % (k,depmc))
+ else:
+ logger.debug("Adding providers for multiconfig dependency %s" % l[3])
+ taskdata[depmc].add_provider(localdata[depmc], self.recipecaches[depmc], l[3])
+ seen.add(k)
+ new = True
for mc in self.multiconfigs:
taskdata[mc].add_unresolved(localdata[mc], self.recipecaches[mc])
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 06/18] msg: Drop unused local variable
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (4 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 05/18] cooker: Drop unused loop Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 07/18] buildinfohelper: Drop unused function Steve Sakoman
` (11 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 140929b404ee1e2f5e0e1a3a1d3aa49fb3759ade)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/msg.py | 1 -
1 file changed, 1 deletion(-)
diff --git a/lib/bb/msg.py b/lib/bb/msg.py
index c95a874b..93575d89 100644
--- a/lib/bb/msg.py
+++ b/lib/bb/msg.py
@@ -133,7 +133,6 @@ class LogFilterShowOnce(logging.Filter):
self.seen_errors = set()
def filter(self, record):
- msg = record.msg
if record.levelno == bb.msg.BBLogFormatter.WARNONCE:
if record.msg in self.seen_warnings:
return False
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 07/18] buildinfohelper: Drop unused function
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (5 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 06/18] msg: Drop unused local variable Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 08/18] fetch2/crate: Drop unused import Steve Sakoman
` (10 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
The function has a loop where the variable is never used which I was going
to fix but the entire function never seems to be called so remove it entirely.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 3bcb20f025907f4e88bbe3d14f5638d5f01010cb)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/ui/buildinfohelper.py | 21 ---------------------
1 file changed, 21 deletions(-)
diff --git a/lib/bb/ui/buildinfohelper.py b/lib/bb/ui/buildinfohelper.py
index 9c4215f9..c4ca2677 100644
--- a/lib/bb/ui/buildinfohelper.py
+++ b/lib/bb/ui/buildinfohelper.py
@@ -1062,27 +1062,6 @@ class BuildInfoHelper(object):
return recipe_info
- def _get_path_information(self, task_object):
- self._ensure_build()
-
- assert isinstance(task_object, Task)
- build_stats_format = "{tmpdir}/buildstats/{buildname}/{package}/"
- build_stats_path = []
-
- for t in self.internal_state['targets']:
- buildname = self.internal_state['build'].build_name
- pe, pv = task_object.recipe.version.split(":",1)
- if pe:
- package = task_object.recipe.name + "-" + pe + "_" + pv
- else:
- package = task_object.recipe.name + "-" + pv
-
- build_stats_path.append(build_stats_format.format(tmpdir=self.tmp_dir,
- buildname=buildname,
- package=package))
-
- return build_stats_path
-
################################
## external available methods to store information
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 08/18] fetch2/crate: Drop unused import
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (6 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 07/18] buildinfohelper: Drop unused function Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 09/18] siggen: Drop pointless break statement Steve Sakoman
` (9 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 879f17ecd5ba09e217cef74f6a51339b145e8ef5)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/fetch2/crate.py | 1 -
1 file changed, 1 deletion(-)
diff --git a/lib/bb/fetch2/crate.py b/lib/bb/fetch2/crate.py
index aac1221c..f4ddc782 100644
--- a/lib/bb/fetch2/crate.py
+++ b/lib/bb/fetch2/crate.py
@@ -13,7 +13,6 @@ BitBake 'Fetch' implementation for crates.io
import hashlib
import json
import os
-import shutil
import subprocess
import bb
from bb.fetch2 import logger, subprocess_setup, UnpackError
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 09/18] siggen: Drop pointless break statement
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (7 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 08/18] fetch2/crate: Drop unused import Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 10/18] ui/knotty: Drop pointless pass statement Steve Sakoman
` (8 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 42809f6acb79e39042e81d54c28efb92b7481e44)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/siggen.py | 1 -
1 file changed, 1 deletion(-)
diff --git a/lib/bb/siggen.py b/lib/bb/siggen.py
index 130b38d8..9fa568f6 100644
--- a/lib/bb/siggen.py
+++ b/lib/bb/siggen.py
@@ -40,7 +40,6 @@ def init(d):
for sg in siggens:
if desired == sg.name:
return sg(d)
- break
else:
logger.error("Invalid signature generator '%s', using default 'noop'\n"
"Available generators: %s", desired,
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 10/18] ui/knotty: Drop pointless pass statement
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (8 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 09/18] siggen: Drop pointless break statement Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 11/18] persist_data: Use a valid exception for missing implementation Steve Sakoman
` (7 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 625565087d8c9e7a6a79b0b4f3e5be2d77d5f100)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/ui/knotty.py | 1 -
1 file changed, 1 deletion(-)
diff --git a/lib/bb/ui/knotty.py b/lib/bb/ui/knotty.py
index 3f410fd5..61cf0a37 100644
--- a/lib/bb/ui/knotty.py
+++ b/lib/bb/ui/knotty.py
@@ -877,7 +877,6 @@ def main(server, eventHandler, params, tf = TerminalFilter):
state_force_shutdown()
main.shutdown = main.shutdown + 1
- pass
except Exception as e:
import traceback
sys.stderr.write(traceback.format_exc())
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 11/18] persist_data: Use a valid exception for missing implementation
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (9 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 10/18] ui/knotty: Drop pointless pass statement Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 12/18] runqueue: Drop pointless variable assignment Steve Sakoman
` (6 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 7254eb6b3e8ef504ef2274541dcc55f1d42238c6)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/persist_data.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/lib/bb/persist_data.py b/lib/bb/persist_data.py
index 9e20a837..ce84a158 100644
--- a/lib/bb/persist_data.py
+++ b/lib/bb/persist_data.py
@@ -208,7 +208,7 @@ class SQLTable(collections.abc.MutableMapping):
def __lt__(self, other):
if not isinstance(other, Mapping):
- raise NotImplemented
+ raise NotImplementedError()
return len(self) < len(other)
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 12/18] runqueue: Drop pointless variable assignment
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (10 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 11/18] persist_data: Use a valid exception for missing implementation Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 13/18] buildinfohelper: Drop unused variables Steve Sakoman
` (5 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
This is set at the start of the loop anyway so it does nothing. Drop
the pointless code.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit e6a3173c9cdf349ccbd4cf612868f92cce8717c8)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/runqueue.py | 1 -
1 file changed, 1 deletion(-)
diff --git a/lib/bb/runqueue.py b/lib/bb/runqueue.py
index a7a84630..a4e82f37 100644
--- a/lib/bb/runqueue.py
+++ b/lib/bb/runqueue.py
@@ -2664,7 +2664,6 @@ def build_scenequeue_data(sqdata, rqdata, rq, cooker, stampcache, sqrq):
sq_revdeps_squash[point] = set()
if point in rqdata.runq_setscene_tids:
sq_revdeps_squash[point] = tasks
- tasks = set()
continue
for dep in rqdata.runtaskentries[point].depends:
if point in sq_revdeps[dep]:
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 13/18] buildinfohelper: Drop unused variables
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (11 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 12/18] runqueue: Drop pointless variable assignment Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 14/18] fetch2/osc: Add missing parameter Steve Sakoman
` (4 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit d720dfa40620e64a557edef527148d58fcb1d858)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/ui/buildinfohelper.py | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/lib/bb/ui/buildinfohelper.py b/lib/bb/ui/buildinfohelper.py
index c4ca2677..129bb329 100644
--- a/lib/bb/ui/buildinfohelper.py
+++ b/lib/bb/ui/buildinfohelper.py
@@ -496,7 +496,7 @@ class ORMWrapper(object):
if not parent_path:
parent_path = "/"
parent_obj = self._cached_get(Target_File, target = target_obj, path = parent_path, inodetype = Target_File.ITYPE_DIRECTORY)
- tf_obj = Target_File.objects.create(
+ Target_File.objects.create(
target = target_obj,
path = path,
size = size,
@@ -561,7 +561,7 @@ class ORMWrapper(object):
parent_obj = Target_File.objects.get(target = target_obj, path = parent_path, inodetype = Target_File.ITYPE_DIRECTORY)
- tf_obj = Target_File.objects.create(
+ Target_File.objects.create(
target = target_obj,
path = path,
size = size,
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 14/18] fetch2/osc: Add missing parameter
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (12 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 13/18] buildinfohelper: Drop unused variables Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 15/18] fetch2/ssh.py: decode path back for ssh Steve Sakoman
` (3 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
This probably means the osc fetcher isn't being used but fix the missing
parameter.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit a23c201cb6efc5c0abf763c26f905442f0eebb68)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/fetch2/osc.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/lib/bb/fetch2/osc.py b/lib/bb/fetch2/osc.py
index d9ce4439..99a529e5 100644
--- a/lib/bb/fetch2/osc.py
+++ b/lib/bb/fetch2/osc.py
@@ -43,7 +43,7 @@ class Osc(FetchMethod):
ud.revision = ud.parm['rev']
else:
pv = d.getVar("PV", False)
- rev = bb.fetch2.srcrev_internal_helper(ud, d)
+ rev = bb.fetch2.srcrev_internal_helper(ud, d, '')
if rev:
ud.revision = rev
else:
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 15/18] fetch2/ssh.py: decode path back for ssh
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (13 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 14/18] fetch2/osc: Add missing parameter Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 16/18] runqueue: Fix sig file location when using multiconfig Steve Sakoman
` (2 subsequent siblings)
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Robert Yang <liezhi.yang@windriver.com>
The path has been encoded by urllib.parse.quote(), so decode it back for ssh.
Fixed when fetch from PREMIRRORS via ssh:
$ bitbake bonnie++ libsigc++-2.0 -cfetch
scp: /path/to/downloads/libsigc%2B%2B-2.10.7.tar.xz: No such file or directory
Signed-off-by: Robert Yang <liezhi.yang@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit c1c8fc678eb4783cea3974328a5fa8d1b79f1266)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/fetch2/ssh.py | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/lib/bb/fetch2/ssh.py b/lib/bb/fetch2/ssh.py
index 48445308..8d082b38 100644
--- a/lib/bb/fetch2/ssh.py
+++ b/lib/bb/fetch2/ssh.py
@@ -32,6 +32,7 @@ IETF secsh internet draft:
import re, os
from bb.fetch2 import check_network_access, FetchMethod, ParameterError, runfetchcmd
+import urllib
__pattern__ = re.compile(r'''
@@ -70,6 +71,7 @@ class SSH(FetchMethod):
"git:// prefix with protocol=ssh", urldata.url)
m = __pattern__.match(urldata.url)
path = m.group('path')
+ path = urllib.parse.unquote(path)
host = m.group('host')
urldata.localpath = os.path.join(d.getVar('DL_DIR'),
os.path.basename(os.path.normpath(path)))
@@ -99,7 +101,7 @@ class SSH(FetchMethod):
if path[0] != '~':
path = '/%s' % path
- path = path.replace("%3A", ":")
+ path = urllib.parse.unquote(path)
fr += ':%s' % path
@@ -139,7 +141,7 @@ class SSH(FetchMethod):
if path[0] != '~':
path = '/%s' % path
- path = path.replace("%3A", ":")
+ path = urllib.parse.unquote(path)
cmd = 'ssh -o BatchMode=true %s %s [ -f %s ]' % (
portarg,
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 16/18] runqueue: Fix sig file location when using multiconfig
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (14 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 15/18] fetch2/ssh.py: decode path back for ssh Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 17/18] cache: correctly handle file names containing colons Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 18/18] fetch/git : Use cat as pager Steve Sakoman
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
We're using the wrong data store when trying to locate siginfo files,
fix this. Thanks to Gregory Lumen <gregorylumen@microsoft.com> for
spotting.
[YOCTO #14774]
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 0ed800e19a3197f8e622c8d3b630aae384e60aba)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/runqueue.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/lib/bb/runqueue.py b/lib/bb/runqueue.py
index a4e82f37..f34f1568 100644
--- a/lib/bb/runqueue.py
+++ b/lib/bb/runqueue.py
@@ -1674,7 +1674,7 @@ class RunQueue:
(mc, fn, taskname, taskfn) = split_tid_mcfn(tid)
pn = self.rqdata.dataCaches[mc].pkg_fn[taskfn]
h = self.rqdata.runtaskentries[tid].hash
- matches = bb.siggen.find_siginfo(pn, taskname, [], self.cfgData)
+ matches = bb.siggen.find_siginfo(pn, taskname, [], self.cooker.databuilder.mcdata[mc])
match = None
for m in matches:
if h in m:
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 17/18] cache: correctly handle file names containing colons
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (15 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 16/18] runqueue: Fix sig file location when using multiconfig Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 18/18] fetch/git : Use cat as pager Steve Sakoman
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Roland Hieber <rhi@pengutronix.de>
File names containing colons cause split() to return a list with more
than two elements, which will lead to a stack trace ending in:
ValueError: too many values to unpack (expected 2)
Split only once at the last colon, thereby making sure that only two
elements are returned.
Signed-off-by: Roland Hieber <rhi@pengutronix.de>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit a70a7376a8708bde07959deb5d5842d7f84ee5f8)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/cache.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/lib/bb/cache.py b/lib/bb/cache.py
index fcb15796..92e9a3ce 100644
--- a/lib/bb/cache.py
+++ b/lib/bb/cache.py
@@ -619,7 +619,7 @@ class Cache(NoCache):
for f in flist:
if not f:
continue
- f, exist = f.split(":")
+ f, exist = f.rsplit(":", 1)
if (exist == "True" and not os.path.exists(f)) or (exist == "False" and os.path.exists(f)):
self.logger.debug2("%s's file checksum list file %s changed",
fn, f)
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread* [bitbake][kirkstone][2.0][PATCH 18/18] fetch/git : Use cat as pager
2022-05-10 18:05 [bitbake][kirkstone][2.0][PATCH 00/18] Patch review Steve Sakoman
` (16 preceding siblings ...)
2022-05-10 18:05 ` [bitbake][kirkstone][2.0][PATCH 17/18] cache: correctly handle file names containing colons Steve Sakoman
@ 2022-05-10 18:05 ` Steve Sakoman
17 siblings, 0 replies; 19+ messages in thread
From: Steve Sakoman @ 2022-05-10 18:05 UTC (permalink / raw)
To: bitbake-devel
From: Richard Purdie <richard.purdie@linuxfoundation.org>
We don't have less in HOSTTOOLS in OE and this can confuse git. Force the
pager to cat to be consistent and minimal everywhere.
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit d3d406e8552fdd865dc58b419a84411736475ad2)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/fetch2/git.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/lib/bb/fetch2/git.py b/lib/bb/fetch2/git.py
index b3eb8248..f0df6fb6 100644
--- a/lib/bb/fetch2/git.py
+++ b/lib/bb/fetch2/git.py
@@ -240,7 +240,7 @@ class Git(FetchMethod):
for name in ud.names:
ud.unresolvedrev[name] = 'HEAD'
- ud.basecmd = d.getVar("FETCHCMD_git") or "git -c core.fsyncobjectfiles=0 -c gc.autoDetach=false"
+ ud.basecmd = d.getVar("FETCHCMD_git") or "git -c core.fsyncobjectfiles=0 -c gc.autoDetach=false -c core.pager=cat"
write_tarballs = d.getVar("BB_GENERATE_MIRROR_TARBALLS") or "0"
ud.write_tarballs = write_tarballs != "0" or ud.rebaseable
--
2.25.1
^ permalink raw reply related [flat|nested] 19+ messages in thread