* [yocto-autobuilder-helper][dunfell 1/3] config.json: Add BB_HASHSERVE to SDK_LOCAL_CONF_BLACKLIST
2021-10-19 20:09 [yocto-autobuilder-helper][dunfell 0/3] Patch review Steve Sakoman
@ 2021-10-19 20:09 ` Steve Sakoman
2021-10-19 20:09 ` [yocto-autobuilder-helper][dunfell 2/3] config.json: Ensure BB_HASHSERVE is set in SDKs to auto Steve Sakoman
2021-10-19 20:09 ` [yocto-autobuilder-helper][dunfell 3/3] config.json: set max load in PARALLEL_MAKE Steve Sakoman
2 siblings, 0 replies; 5+ messages in thread
From: Steve Sakoman @ 2021-10-19 20:09 UTC (permalink / raw)
To: yocto
From: Richard Purdie <richard.purdie@linuxfoundation.org>
This should avoid issues with the hashequiv code attempting to contact
an non-existent server in the eSDKs built by the project.
[YOCTO #14471]
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 4db17f4c9da4efb48d428256efb696d86935a3ea)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
config.json | 1 +
1 file changed, 1 insertion(+)
diff --git a/config.json b/config.json
index d871349..571ddae 100644
--- a/config.json
+++ b/config.json
@@ -55,6 +55,7 @@
"SANITY_TESTED_DISTROS = ''",
"SDK_EXT_TYPE = 'minimal'",
"SDK_INCLUDE_TOOLCHAIN = '1'",
+ "SDK_LOCAL_CONF_BLACKLIST:append = 'BB_HASHSERVE'",
"BB_DISKMON_DIRS = 'STOPTASKS,${TMPDIR},1G,100K STOPTASKS,${DL_DIR},1G STOPTASKS,${SSTATE_DIR},1G STOPTASKS,/tmp,100M,100K ABORT,${TMPDIR},100M,1K ABORT,${DL_DIR},100M ABORT,${SSTATE_DIR},100M ABORT,/tmp,10M,1K'",
"BB_HASHSERVE = 'typhoon.yocto.io:8686'"
]
--
2.25.1
^ permalink raw reply related [flat|nested] 5+ messages in thread* [yocto-autobuilder-helper][dunfell 2/3] config.json: Ensure BB_HASHSERVE is set in SDKs to auto
2021-10-19 20:09 [yocto-autobuilder-helper][dunfell 0/3] Patch review Steve Sakoman
2021-10-19 20:09 ` [yocto-autobuilder-helper][dunfell 1/3] config.json: Add BB_HASHSERVE to SDK_LOCAL_CONF_BLACKLIST Steve Sakoman
@ 2021-10-19 20:09 ` Steve Sakoman
2021-10-19 20:09 ` [yocto-autobuilder-helper][dunfell 3/3] config.json: set max load in PARALLEL_MAKE Steve Sakoman
2 siblings, 0 replies; 5+ messages in thread
From: Steve Sakoman @ 2021-10-19 20:09 UTC (permalink / raw)
To: yocto
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 4689763b513521fc70cca576b88035de240a3ba6)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
config.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/config.json b/config.json
index 571ddae..fa475e3 100644
--- a/config.json
+++ b/config.json
@@ -31,7 +31,7 @@
"DLDIR" : "DL_DIR = '${BASE_SHAREDDIR}/current_sources'",
"SSTATEDIR" : ["SSTATE_DIR ?= '${BASE_SHAREDDIR}/pub/sstate-dunfell'"],
"SSTATEDIR_RELEASE" : ["SSTATE_MIRRORS += 'file://.* file://${BASE_SHAREDDIR}/pub/sstate-dunfell/PATH'", "SSTATE_DIR ?= '${BASE_PUBLISHDIR}/sstate/@RELEASENUM@'"],
- "SDKEXTRAS" : ["SSTATE_MIRRORS += '\\", "file://.* http://sstate.yoctoproject.org/dev/@RELEASENUM@PATH;downloadfilename=PATH'"],
+ "SDKEXTRAS" : ["SSTATE_MIRRORS += '\\", "file://.* http://sstate.yoctoproject.org/dev/@RELEASENUM@PATH;downloadfilename=PATH'", "BB_HASHSERVE = 'auto'"],
"BUILDINFO" : false,
"BUILDHISTORY" : false,
"BUILDINFOVARS" : ["INHERIT += 'image-buildinfo'", "IMAGE_BUILDINFO_VARS_append = ' IMAGE_BASENAME IMAGE_NAME'"],
--
2.25.1
^ permalink raw reply related [flat|nested] 5+ messages in thread* [yocto-autobuilder-helper][dunfell 3/3] config.json: set max load in PARALLEL_MAKE
2021-10-19 20:09 [yocto-autobuilder-helper][dunfell 0/3] Patch review Steve Sakoman
2021-10-19 20:09 ` [yocto-autobuilder-helper][dunfell 1/3] config.json: Add BB_HASHSERVE to SDK_LOCAL_CONF_BLACKLIST Steve Sakoman
2021-10-19 20:09 ` [yocto-autobuilder-helper][dunfell 2/3] config.json: Ensure BB_HASHSERVE is set in SDKs to auto Steve Sakoman
@ 2021-10-19 20:09 ` Steve Sakoman
2 siblings, 0 replies; 5+ messages in thread
From: Steve Sakoman @ 2021-10-19 20:09 UTC (permalink / raw)
To: yocto
From: Trevor Gamblin <trevor.gamblin@windriver.com>
Add "-l 52" to PARALLEL_MAKE in config.json to limit Make and Ninja
builds based on the detected system load. With this option added, if
either tool has at least one job running and detects that the system
load exceeds the given value, it will wait until either the system load
average drops below that limit, or until all other jobs are finished
before starting additional jobs.
Since most autobuilder machines have 56 cores, this should help keep the
system from being overloaded during builds.
Reference: https://www.gnu.org/software/make/manual/html_node/Parallel.html
Signed-off-by: Trevor Gamblin <trevor.gamblin@windriver.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
(cherry picked from commit 5c5fc7bcd221427d34bbac80c9bad315fb6de4df)
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
config.json | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/config.json b/config.json
index fa475e3..cbb0f5b 100644
--- a/config.json
+++ b/config.json
@@ -43,7 +43,7 @@
"PREMIRRORS = ''",
"BB_GENERATE_MIRROR_TARBALLS = '1'",
"BB_NUMBER_THREADS = '16'",
- "PARALLEL_MAKE = '-j 16'",
+ "PARALLEL_MAKE = '-j 16 -l 52'",
"XZ_MEMLIMIT = '5%'",
"XZ_THREADS = '8'",
"BB_TASK_NICE_LEVEL = '5'",
--
2.25.1
^ permalink raw reply related [flat|nested] 5+ messages in thread