* [kirkstone][PATCH 0/3] kernel: Backport v6.3+ localversion fixes
@ 2024-02-22 10:35 Andreas Helbech Kleist
2024-02-22 10:35 ` [kirkstone][PATCH 1/3] kernel.bbclass: introduce KERNEL_LOCALVERSION Andreas Helbech Kleist
` (2 more replies)
0 siblings, 3 replies; 8+ messages in thread
From: Andreas Helbech Kleist @ 2024-02-22 10:35 UTC (permalink / raw)
To: openembedded-core; +Cc: reatmon
Without this, kernels v6.3 and later have wrong localversion '+' appended.
Bruce Ashfield (2):
kernel: fix localversion in v6.3+
kernel: make LOCALVERSION consistent between recipes
Ming Liu (1):
kernel.bbclass: introduce KERNEL_LOCALVERSION
meta/classes/kernel-arch.bbclass | 1 -
meta/classes/kernel.bbclass | 24 +++++++++++++++++--
meta/classes/kernelsrc.bbclass | 1 +
meta/classes/linux-kernel-base.bbclass | 11 +++++++++
meta/classes/module-base.bbclass | 1 +
meta/conf/documentation.conf | 1 +
.../make-mod-scripts/make-mod-scripts_1.0.bb | 3 +++
7 files changed, 39 insertions(+), 3 deletions(-)
--
2.43.2
^ permalink raw reply [flat|nested] 8+ messages in thread* [kirkstone][PATCH 1/3] kernel.bbclass: introduce KERNEL_LOCALVERSION 2024-02-22 10:35 [kirkstone][PATCH 0/3] kernel: Backport v6.3+ localversion fixes Andreas Helbech Kleist @ 2024-02-22 10:35 ` Andreas Helbech Kleist 2024-02-22 10:35 ` [kirkstone][PATCH 2/3] kernel: fix localversion in v6.3+ Andreas Helbech Kleist 2024-02-22 10:35 ` [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes Andreas Helbech Kleist 2 siblings, 0 replies; 8+ messages in thread From: Andreas Helbech Kleist @ 2024-02-22 10:35 UTC (permalink / raw) To: openembedded-core; +Cc: reatmon From: Ming Liu <liu.ming50@gmail.com> Just like UBOOT_LOCALVERSION, an end user can set KERNEL_LOCALVERSION to append a string to the name of the local version of the kernel image. Signed-off-by: Ming Liu <liu.ming50@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> cherry-picked from master 229435a52f36ddec5f85fb6d5ccd42044b688397 Signed-off-by: Andreas Helbech Kleist <andreaskleist@gmail.com> --- meta/classes/kernel.bbclass | 6 +++++- meta/conf/documentation.conf | 1 + 2 files changed, 6 insertions(+), 1 deletion(-) diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass index 5951347361..80fb1879b0 100644 --- a/meta/classes/kernel.bbclass +++ b/meta/classes/kernel.bbclass @@ -614,6 +614,7 @@ do_shared_workdir () { # We don't need to stage anything, not the modules/firmware since those would clash with linux-firmware SYSROOT_DIRS = "" +KERNEL_LOCALVERSION ??= "" KERNEL_CONFIG_COMMAND ?= "oe_runmake_call -C ${S} O=${B} olddefconfig || oe_runmake -C ${S} O=${B} oldnoconfig" python check_oldest_kernel() { @@ -635,7 +636,10 @@ kernel_do_configure() { # $ scripts/setlocalversion . => + # $ make kernelversion => 2.6.37 # $ make kernelrelease => 2.6.37+ - touch ${B}/.scmversion ${S}/.scmversion + if [ ! -e ${B}/.scmversion -a ! -e ${S}/.scmversion ]; then + echo ${KERNEL_LOCALVERSION} > ${B}/.scmversion + echo ${KERNEL_LOCALVERSION} > ${S}/.scmversion + fi if [ "${S}" != "${B}" ] && [ -f "${S}/.config" ] && [ ! -f "${B}/.config" ]; then mv "${S}/.config" "${B}/.config" diff --git a/meta/conf/documentation.conf b/meta/conf/documentation.conf index ab2addb321..e55bfa288d 100644 --- a/meta/conf/documentation.conf +++ b/meta/conf/documentation.conf @@ -253,6 +253,7 @@ KERNEL_MODULE_PROBECONF[doc] = "Lists kernel modules for which the build system KERNEL_PACKAGE_NAME[doc] = "Name prefix for kernel packages. Defaults to 'kernel'." KERNEL_PATH[doc] = "The location of the kernel sources. This variable is set to the value of the STAGING_KERNEL_DIR within the module class (module.bbclass)." KERNEL_SRC[doc] = "The location of the kernel sources. This variable is set to the value of the STAGING_KERNEL_DIR within the module class (module.bbclass)." +KERNEL_LOCALVERSION[doc] = "Appends a string to the name of the local version of the kernel image." KFEATURE_DESCRIPTION[doc] = "Provides a short description of a configuration fragment. You use this variable in the .scc file that describes a configuration fragment file." KMACHINE[doc] = "The machine as known by the kernel." KTYPE[doc] = "Defines the kernel type to be used in assembling the configuration." -- 2.43.2 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* [kirkstone][PATCH 2/3] kernel: fix localversion in v6.3+ 2024-02-22 10:35 [kirkstone][PATCH 0/3] kernel: Backport v6.3+ localversion fixes Andreas Helbech Kleist 2024-02-22 10:35 ` [kirkstone][PATCH 1/3] kernel.bbclass: introduce KERNEL_LOCALVERSION Andreas Helbech Kleist @ 2024-02-22 10:35 ` Andreas Helbech Kleist 2024-02-22 10:35 ` [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes Andreas Helbech Kleist 2 siblings, 0 replies; 8+ messages in thread From: Andreas Helbech Kleist @ 2024-02-22 10:35 UTC (permalink / raw) To: openembedded-core; +Cc: reatmon From: Bruce Ashfield <bruce.ashfield@gmail.com> During testing of the v6.4 reference kernel, it was noticed that on-target modules no longer matched the magic value of the running kernel. This was due to a different localversion in the cross built kernel and the scripts / resources created on target. This was due to changes in the setlocalversion script introduced in the v6.3 series. The .scmversion file is no longer used (or packaged) to inhibit the addition of a "+" (through querying of the git status of the kernel) or the setting of a local version. We recently introduced the KERNEL_LOCALVERSION variable to allow recipes to place a value in .scmversion, so we extend the use of that variable to kernel-arch.bbclass and use it to set the exported variable LOCALVERSION. We must do it at the kernel-arch level, as the variable must be exported in any kernel build to ensure that setlocalversion always correctly sets the localversion. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org> cherry-picked from master 765b13b7305c8d2f222cfc66d77c02e6a088c691 Signed-off-by: Andreas Helbech Kleist <andreaskleist@gmail.com> --- meta/classes/kernel-arch.bbclass | 7 +++++++ meta/classes/kernel.bbclass | 6 ++++-- 2 files changed, 11 insertions(+), 2 deletions(-) diff --git a/meta/classes/kernel-arch.bbclass b/meta/classes/kernel-arch.bbclass index 4cd08b96fb..0a79dea0af 100644 --- a/meta/classes/kernel-arch.bbclass +++ b/meta/classes/kernel-arch.bbclass @@ -66,3 +66,10 @@ KERNEL_LD = "${CCACHE}${HOST_PREFIX}ld.bfd ${HOST_LD_KERNEL_ARCH}" KERNEL_AR = "${CCACHE}${HOST_PREFIX}ar ${HOST_AR_KERNEL_ARCH}" TOOLCHAIN ?= "gcc" +# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in +# the local version. Having it empty means nothing will be added, and any +# value will be appended to the local kernel version. This replaces the +# use of .scmversion file for setting a localversion without using +# the CONFIG_LOCALVERSION option. +KERNEL_LOCALVERSION ??= "" +export LOCALVERSION ?= "${KERNEL_LOCALVERSION}" diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass index 80fb1879b0..940f1a3cf4 100644 --- a/meta/classes/kernel.bbclass +++ b/meta/classes/kernel.bbclass @@ -418,7 +418,7 @@ do_compile_kernelmodules() { if (grep -q -i -e '^CONFIG_MODULES=y$' ${B}/.config); then oe_runmake -C ${B} ${PARALLEL_MAKE} modules ${KERNEL_EXTRA_ARGS} - # Module.symvers gets updated during the + # Module.symvers gets updated during the # building of the kernel modules. We need to # update this in the shared workdir since some # external kernel modules has a dependency on @@ -614,7 +614,6 @@ do_shared_workdir () { # We don't need to stage anything, not the modules/firmware since those would clash with linux-firmware SYSROOT_DIRS = "" -KERNEL_LOCALVERSION ??= "" KERNEL_CONFIG_COMMAND ?= "oe_runmake_call -C ${S} O=${B} olddefconfig || oe_runmake -C ${S} O=${B} oldnoconfig" python check_oldest_kernel() { @@ -636,6 +635,9 @@ kernel_do_configure() { # $ scripts/setlocalversion . => + # $ make kernelversion => 2.6.37 # $ make kernelrelease => 2.6.37+ + # See kernel-arch.bbclass for post v6.3 removal of the extra + # + in localversion. .scmversion is no longer used, and the + # variable LOCALVERSION must be used if [ ! -e ${B}/.scmversion -a ! -e ${S}/.scmversion ]; then echo ${KERNEL_LOCALVERSION} > ${B}/.scmversion echo ${KERNEL_LOCALVERSION} > ${S}/.scmversion -- 2.43.2 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes 2024-02-22 10:35 [kirkstone][PATCH 0/3] kernel: Backport v6.3+ localversion fixes Andreas Helbech Kleist 2024-02-22 10:35 ` [kirkstone][PATCH 1/3] kernel.bbclass: introduce KERNEL_LOCALVERSION Andreas Helbech Kleist 2024-02-22 10:35 ` [kirkstone][PATCH 2/3] kernel: fix localversion in v6.3+ Andreas Helbech Kleist @ 2024-02-22 10:35 ` Andreas Helbech Kleist 2024-02-22 21:51 ` Ryan Eatmon 2 siblings, 1 reply; 8+ messages in thread From: Andreas Helbech Kleist @ 2024-02-22 10:35 UTC (permalink / raw) To: openembedded-core; +Cc: reatmon From: Bruce Ashfield <bruce.ashfield@gmail.com> The initial fix for localversion setting in 6.3+ broke older recipes and also broke recipes setting localversion in a kernel recipe, as make-mod-scripts (and other locations) can trigger a regeneration of files and don't have access to the variable. Moving the setting of this variable to the global namespace doesn't make sense, so we follow the example of the kernel-abiversion and save a kernel-localversion to the build artifacts. Recipes that may regenerate scripts/dynamic files, must depend on the do_shared_workedir of the kernel and use the helper function to read the file storing the localversion. Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> cherry-picked from master b378eec156998eea55ba61e59103cb34fab0d07c Signed-off-by: Andreas Helbech Kleist <andreaskleist@gmail.com> --- meta/classes/kernel-arch.bbclass | 8 -------- meta/classes/kernel.bbclass | 14 ++++++++++++++ meta/classes/kernelsrc.bbclass | 1 + meta/classes/linux-kernel-base.bbclass | 11 +++++++++++ meta/classes/module-base.bbclass | 1 + .../make-mod-scripts/make-mod-scripts_1.0.bb | 3 +++ 6 files changed, 30 insertions(+), 8 deletions(-) diff --git a/meta/classes/kernel-arch.bbclass b/meta/classes/kernel-arch.bbclass index 0a79dea0af..62c8211621 100644 --- a/meta/classes/kernel-arch.bbclass +++ b/meta/classes/kernel-arch.bbclass @@ -65,11 +65,3 @@ KERNEL_CC = "${CCACHE}${HOST_PREFIX}gcc ${HOST_CC_KERNEL_ARCH} -fuse-ld=bfd ${DE KERNEL_LD = "${CCACHE}${HOST_PREFIX}ld.bfd ${HOST_LD_KERNEL_ARCH}" KERNEL_AR = "${CCACHE}${HOST_PREFIX}ar ${HOST_AR_KERNEL_ARCH}" TOOLCHAIN ?= "gcc" - -# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in -# the local version. Having it empty means nothing will be added, and any -# value will be appended to the local kernel version. This replaces the -# use of .scmversion file for setting a localversion without using -# the CONFIG_LOCALVERSION option. -KERNEL_LOCALVERSION ??= "" -export LOCALVERSION ?= "${KERNEL_LOCALVERSION}" diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass index 940f1a3cf4..96e41b5192 100644 --- a/meta/classes/kernel.bbclass +++ b/meta/classes/kernel.bbclass @@ -541,6 +541,7 @@ do_shared_workdir () { # echo "${KERNEL_VERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-abiversion + echo "${KERNEL_LOCALVERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-localversion # Copy files required for module builds cp System.map $kerneldir/System.map-${KERNEL_VERSION} @@ -630,6 +631,19 @@ python check_oldest_kernel() { check_oldest_kernel[vardepsexclude] += "OLDEST_KERNEL KERNEL_VERSION" do_configure[prefuncs] += "check_oldest_kernel" +KERNEL_LOCALVERSION ??= "" + +# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in +# the local version. Having it empty means nothing will be added, and any +# value will be appended to the local kernel version. This replaces the +# use of .scmversion file for setting a localversion without using +# the CONFIG_LOCALVERSION option. +# +# Note: This class saves the value of localversion to a file +# so other recipes like make-mod-scripts can restore it via the +# helper function get_kernellocalversion_file +export LOCALVERSION="${KERNEL_LOCALVERSION}" + kernel_do_configure() { # fixes extra + in /lib/modules/2.6.37+ # $ scripts/setlocalversion . => + diff --git a/meta/classes/kernelsrc.bbclass b/meta/classes/kernelsrc.bbclass index a951ba3325..a79bf18b09 100644 --- a/meta/classes/kernelsrc.bbclass +++ b/meta/classes/kernelsrc.bbclass @@ -5,6 +5,7 @@ do_patch[depends] += "virtual/kernel:do_shared_workdir" do_patch[noexec] = "1" do_package[depends] += "virtual/kernel:do_populate_sysroot" KERNEL_VERSION = "${@get_kernelversion_file("${STAGING_KERNEL_BUILDDIR}")}" +LOCAL_VERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" inherit linux-kernel-base diff --git a/meta/classes/linux-kernel-base.bbclass b/meta/classes/linux-kernel-base.bbclass index 73a6fe36d9..0e2a4a4abe 100644 --- a/meta/classes/linux-kernel-base.bbclass +++ b/meta/classes/linux-kernel-base.bbclass @@ -33,6 +33,17 @@ def get_kernelversion_file(p): except IOError: return None +def get_kernellocalversion_file(p): + fn = p + '/kernel-localversion' + + try: + with open(fn, 'r') as f: + return f.readlines()[0].strip() + except IOError: + return "" + + return "" + def linux_module_packages(s, d): suffix = "" return " ".join(map(lambda s: "kernel-module-%s%s" % (s.lower().replace('_', '-').replace('@', '+'), suffix), s.split())) diff --git a/meta/classes/module-base.bbclass b/meta/classes/module-base.bbclass index 27bd69ff33..5b2fde8144 100644 --- a/meta/classes/module-base.bbclass +++ b/meta/classes/module-base.bbclass @@ -14,6 +14,7 @@ export CROSS_COMPILE = "${TARGET_PREFIX}" export KBUILD_OUTPUT = "${STAGING_KERNEL_BUILDDIR}" export KERNEL_VERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-abiversion')}" +export LOCALVERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-localversion')}" KERNEL_OBJECT_SUFFIX = ".ko" # kernel modules are generally machine specific diff --git a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb index f6f47cfff5..8727d003f9 100644 --- a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb +++ b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb @@ -21,6 +21,9 @@ DEPENDS += "gmp-native" EXTRA_OEMAKE = " HOSTCC="${BUILD_CC} ${BUILD_CFLAGS} ${BUILD_LDFLAGS}" HOSTCPP="${BUILD_CPP}"" EXTRA_OEMAKE += " HOSTCXX="${BUILD_CXX} ${BUILD_CXXFLAGS} ${BUILD_LDFLAGS}" CROSS_COMPILE=${TARGET_PREFIX}" +KERNEL_LOCALVERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" +export LOCALVERSION="${KERNEL_LOCALVERSION}" + # Build some host tools under work-shared. CC, LD, and AR are probably # not used, but this is the historical way of invoking "make scripts". # -- 2.43.2 ^ permalink raw reply related [flat|nested] 8+ messages in thread
* Re: [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes 2024-02-22 10:35 ` [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes Andreas Helbech Kleist @ 2024-02-22 21:51 ` Ryan Eatmon 2024-02-22 21:56 ` [OE-core] " Bruce Ashfield 0 siblings, 1 reply; 8+ messages in thread From: Ryan Eatmon @ 2024-02-22 21:51 UTC (permalink / raw) To: Andreas Helbech Kleist, openembedded-core On 2/22/2024 4:35 AM, Andreas Helbech Kleist wrote: > From: Bruce Ashfield <bruce.ashfield@gmail.com> > > The initial fix for localversion setting in 6.3+ broke older > recipes and also broke recipes setting localversion in a kernel > recipe, as make-mod-scripts (and other locations) can trigger > a regeneration of files and don't have access to the variable. > > Moving the setting of this variable to the global namespace > doesn't make sense, so we follow the example of the kernel-abiversion > and save a kernel-localversion to the build artifacts. > > Recipes that may regenerate scripts/dynamic files, must > depend on the do_shared_workedir of the kernel and use the helper > function to read the file storing the localversion. > > Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> > Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> > > cherry-picked from master b378eec156998eea55ba61e59103cb34fab0d07c > > Signed-off-by: Andreas Helbech Kleist <andreaskleist@gmail.com> I'm not sure what is going on with our meta-ti testing. This set of changes causes the same issue we were seeing before. Plus, now that I'm looking into it deeper, I'm seeing a breakage in master related to these same patches on there. Not sure why the changes were not caught in our testing on master back when the patches were accepted there... Clearly I need some better checks on the images as part of our QC process... I need to figure out how to fix the issue on master and see if the same change can be applied to these patches on kirkstone. I'll try and get all this done as quickly as I can. > --- > meta/classes/kernel-arch.bbclass | 8 -------- > meta/classes/kernel.bbclass | 14 ++++++++++++++ > meta/classes/kernelsrc.bbclass | 1 + > meta/classes/linux-kernel-base.bbclass | 11 +++++++++++ > meta/classes/module-base.bbclass | 1 + > .../make-mod-scripts/make-mod-scripts_1.0.bb | 3 +++ > 6 files changed, 30 insertions(+), 8 deletions(-) > > diff --git a/meta/classes/kernel-arch.bbclass b/meta/classes/kernel-arch.bbclass > index 0a79dea0af..62c8211621 100644 > --- a/meta/classes/kernel-arch.bbclass > +++ b/meta/classes/kernel-arch.bbclass > @@ -65,11 +65,3 @@ KERNEL_CC = "${CCACHE}${HOST_PREFIX}gcc ${HOST_CC_KERNEL_ARCH} -fuse-ld=bfd ${DE > KERNEL_LD = "${CCACHE}${HOST_PREFIX}ld.bfd ${HOST_LD_KERNEL_ARCH}" > KERNEL_AR = "${CCACHE}${HOST_PREFIX}ar ${HOST_AR_KERNEL_ARCH}" > TOOLCHAIN ?= "gcc" > - > -# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in > -# the local version. Having it empty means nothing will be added, and any > -# value will be appended to the local kernel version. This replaces the > -# use of .scmversion file for setting a localversion without using > -# the CONFIG_LOCALVERSION option. > -KERNEL_LOCALVERSION ??= "" > -export LOCALVERSION ?= "${KERNEL_LOCALVERSION}" > diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass > index 940f1a3cf4..96e41b5192 100644 > --- a/meta/classes/kernel.bbclass > +++ b/meta/classes/kernel.bbclass > @@ -541,6 +541,7 @@ do_shared_workdir () { > # > > echo "${KERNEL_VERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-abiversion > + echo "${KERNEL_LOCALVERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-localversion > > # Copy files required for module builds > cp System.map $kerneldir/System.map-${KERNEL_VERSION} > @@ -630,6 +631,19 @@ python check_oldest_kernel() { > check_oldest_kernel[vardepsexclude] += "OLDEST_KERNEL KERNEL_VERSION" > do_configure[prefuncs] += "check_oldest_kernel" > > +KERNEL_LOCALVERSION ??= "" > + > +# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in > +# the local version. Having it empty means nothing will be added, and any > +# value will be appended to the local kernel version. This replaces the > +# use of .scmversion file for setting a localversion without using > +# the CONFIG_LOCALVERSION option. > +# > +# Note: This class saves the value of localversion to a file > +# so other recipes like make-mod-scripts can restore it via the > +# helper function get_kernellocalversion_file > +export LOCALVERSION="${KERNEL_LOCALVERSION}" > + > kernel_do_configure() { > # fixes extra + in /lib/modules/2.6.37+ > # $ scripts/setlocalversion . => + > diff --git a/meta/classes/kernelsrc.bbclass b/meta/classes/kernelsrc.bbclass > index a951ba3325..a79bf18b09 100644 > --- a/meta/classes/kernelsrc.bbclass > +++ b/meta/classes/kernelsrc.bbclass > @@ -5,6 +5,7 @@ do_patch[depends] += "virtual/kernel:do_shared_workdir" > do_patch[noexec] = "1" > do_package[depends] += "virtual/kernel:do_populate_sysroot" > KERNEL_VERSION = "${@get_kernelversion_file("${STAGING_KERNEL_BUILDDIR}")}" > +LOCAL_VERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" > > inherit linux-kernel-base > > diff --git a/meta/classes/linux-kernel-base.bbclass b/meta/classes/linux-kernel-base.bbclass > index 73a6fe36d9..0e2a4a4abe 100644 > --- a/meta/classes/linux-kernel-base.bbclass > +++ b/meta/classes/linux-kernel-base.bbclass > @@ -33,6 +33,17 @@ def get_kernelversion_file(p): > except IOError: > return None > > +def get_kernellocalversion_file(p): > + fn = p + '/kernel-localversion' > + > + try: > + with open(fn, 'r') as f: > + return f.readlines()[0].strip() > + except IOError: > + return "" > + > + return "" > + > def linux_module_packages(s, d): > suffix = "" > return " ".join(map(lambda s: "kernel-module-%s%s" % (s.lower().replace('_', '-').replace('@', '+'), suffix), s.split())) > diff --git a/meta/classes/module-base.bbclass b/meta/classes/module-base.bbclass > index 27bd69ff33..5b2fde8144 100644 > --- a/meta/classes/module-base.bbclass > +++ b/meta/classes/module-base.bbclass > @@ -14,6 +14,7 @@ export CROSS_COMPILE = "${TARGET_PREFIX}" > export KBUILD_OUTPUT = "${STAGING_KERNEL_BUILDDIR}" > > export KERNEL_VERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-abiversion')}" > +export LOCALVERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-localversion')}" > KERNEL_OBJECT_SUFFIX = ".ko" > > # kernel modules are generally machine specific > diff --git a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb > index f6f47cfff5..8727d003f9 100644 > --- a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb > +++ b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb > @@ -21,6 +21,9 @@ DEPENDS += "gmp-native" > EXTRA_OEMAKE = " HOSTCC="${BUILD_CC} ${BUILD_CFLAGS} ${BUILD_LDFLAGS}" HOSTCPP="${BUILD_CPP}"" > EXTRA_OEMAKE += " HOSTCXX="${BUILD_CXX} ${BUILD_CXXFLAGS} ${BUILD_LDFLAGS}" CROSS_COMPILE=${TARGET_PREFIX}" > > +KERNEL_LOCALVERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" > +export LOCALVERSION="${KERNEL_LOCALVERSION}" > + > # Build some host tools under work-shared. CC, LD, and AR are probably > # not used, but this is the historical way of invoking "make scripts". > # -- Ryan Eatmon reatmon@ti.com ----------------------------------------- Texas Instruments, Inc. - LCPD - MGTS ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [OE-core] [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes 2024-02-22 21:51 ` Ryan Eatmon @ 2024-02-22 21:56 ` Bruce Ashfield 2024-02-22 22:46 ` Ryan Eatmon [not found] ` <17B650DBED7FC1F0.14827@lists.openembedded.org> 0 siblings, 2 replies; 8+ messages in thread From: Bruce Ashfield @ 2024-02-22 21:56 UTC (permalink / raw) To: reatmon; +Cc: Andreas Helbech Kleist, openembedded-core On Thu, Feb 22, 2024 at 4:51 PM Ryan Eatmon via lists.openembedded.org <reatmon=ti.com@lists.openembedded.org> wrote: > > > > On 2/22/2024 4:35 AM, Andreas Helbech Kleist wrote: > > From: Bruce Ashfield <bruce.ashfield@gmail.com> > > > > The initial fix for localversion setting in 6.3+ broke older > > recipes and also broke recipes setting localversion in a kernel > > recipe, as make-mod-scripts (and other locations) can trigger > > a regeneration of files and don't have access to the variable. > > > > Moving the setting of this variable to the global namespace > > doesn't make sense, so we follow the example of the kernel-abiversion > > and save a kernel-localversion to the build artifacts. > > > > Recipes that may regenerate scripts/dynamic files, must > > depend on the do_shared_workedir of the kernel and use the helper > > function to read the file storing the localversion. > > > > Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> > > Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> > > > > cherry-picked from master b378eec156998eea55ba61e59103cb34fab0d07c > > > > Signed-off-by: Andreas Helbech Kleist <andreaskleist@gmail.com> > > I'm not sure what is going on with our meta-ti testing. This set of > changes causes the same issue we were seeing before. Plus, now that I'm > looking into it deeper, I'm seeing a breakage in master related to these > same patches on there. Not sure why the changes were not caught in our > testing on master back when the patches were accepted there... Clearly > I need some better checks on the images as part of our QC process... > > I need to figure out how to fix the issue on master and see if the same > change can be applied to these patches on kirkstone. I'll try and get > all this done as quickly as I can. Please make sure to copy me directly, both as the maintainer of the parts of core in question and the author of the patches. We've had no reports of issues since any of these went in, and they aren't exactly a recent change. Which obviously means there's potentially something different in the environment or the kernel recipes. If you get a set of reproducing steps with linux-yocto and core, I can lend a hand with any fixes. Bruce > > > > > --- > > meta/classes/kernel-arch.bbclass | 8 -------- > > meta/classes/kernel.bbclass | 14 ++++++++++++++ > > meta/classes/kernelsrc.bbclass | 1 + > > meta/classes/linux-kernel-base.bbclass | 11 +++++++++++ > > meta/classes/module-base.bbclass | 1 + > > .../make-mod-scripts/make-mod-scripts_1.0.bb | 3 +++ > > 6 files changed, 30 insertions(+), 8 deletions(-) > > > > diff --git a/meta/classes/kernel-arch.bbclass b/meta/classes/kernel-arch.bbclass > > index 0a79dea0af..62c8211621 100644 > > --- a/meta/classes/kernel-arch.bbclass > > +++ b/meta/classes/kernel-arch.bbclass > > @@ -65,11 +65,3 @@ KERNEL_CC = "${CCACHE}${HOST_PREFIX}gcc ${HOST_CC_KERNEL_ARCH} -fuse-ld=bfd ${DE > > KERNEL_LD = "${CCACHE}${HOST_PREFIX}ld.bfd ${HOST_LD_KERNEL_ARCH}" > > KERNEL_AR = "${CCACHE}${HOST_PREFIX}ar ${HOST_AR_KERNEL_ARCH}" > > TOOLCHAIN ?= "gcc" > > - > > -# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in > > -# the local version. Having it empty means nothing will be added, and any > > -# value will be appended to the local kernel version. This replaces the > > -# use of .scmversion file for setting a localversion without using > > -# the CONFIG_LOCALVERSION option. > > -KERNEL_LOCALVERSION ??= "" > > -export LOCALVERSION ?= "${KERNEL_LOCALVERSION}" > > diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass > > index 940f1a3cf4..96e41b5192 100644 > > --- a/meta/classes/kernel.bbclass > > +++ b/meta/classes/kernel.bbclass > > @@ -541,6 +541,7 @@ do_shared_workdir () { > > # > > > > echo "${KERNEL_VERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-abiversion > > + echo "${KERNEL_LOCALVERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-localversion > > > > # Copy files required for module builds > > cp System.map $kerneldir/System.map-${KERNEL_VERSION} > > @@ -630,6 +631,19 @@ python check_oldest_kernel() { > > check_oldest_kernel[vardepsexclude] += "OLDEST_KERNEL KERNEL_VERSION" > > do_configure[prefuncs] += "check_oldest_kernel" > > > > +KERNEL_LOCALVERSION ??= "" > > + > > +# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in > > +# the local version. Having it empty means nothing will be added, and any > > +# value will be appended to the local kernel version. This replaces the > > +# use of .scmversion file for setting a localversion without using > > +# the CONFIG_LOCALVERSION option. > > +# > > +# Note: This class saves the value of localversion to a file > > +# so other recipes like make-mod-scripts can restore it via the > > +# helper function get_kernellocalversion_file > > +export LOCALVERSION="${KERNEL_LOCALVERSION}" > > + > > kernel_do_configure() { > > # fixes extra + in /lib/modules/2.6.37+ > > # $ scripts/setlocalversion . => + > > diff --git a/meta/classes/kernelsrc.bbclass b/meta/classes/kernelsrc.bbclass > > index a951ba3325..a79bf18b09 100644 > > --- a/meta/classes/kernelsrc.bbclass > > +++ b/meta/classes/kernelsrc.bbclass > > @@ -5,6 +5,7 @@ do_patch[depends] += "virtual/kernel:do_shared_workdir" > > do_patch[noexec] = "1" > > do_package[depends] += "virtual/kernel:do_populate_sysroot" > > KERNEL_VERSION = "${@get_kernelversion_file("${STAGING_KERNEL_BUILDDIR}")}" > > +LOCAL_VERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" > > > > inherit linux-kernel-base > > > > diff --git a/meta/classes/linux-kernel-base.bbclass b/meta/classes/linux-kernel-base.bbclass > > index 73a6fe36d9..0e2a4a4abe 100644 > > --- a/meta/classes/linux-kernel-base.bbclass > > +++ b/meta/classes/linux-kernel-base.bbclass > > @@ -33,6 +33,17 @@ def get_kernelversion_file(p): > > except IOError: > > return None > > > > +def get_kernellocalversion_file(p): > > + fn = p + '/kernel-localversion' > > + > > + try: > > + with open(fn, 'r') as f: > > + return f.readlines()[0].strip() > > + except IOError: > > + return "" > > + > > + return "" > > + > > def linux_module_packages(s, d): > > suffix = "" > > return " ".join(map(lambda s: "kernel-module-%s%s" % (s.lower().replace('_', '-').replace('@', '+'), suffix), s.split())) > > diff --git a/meta/classes/module-base.bbclass b/meta/classes/module-base.bbclass > > index 27bd69ff33..5b2fde8144 100644 > > --- a/meta/classes/module-base.bbclass > > +++ b/meta/classes/module-base.bbclass > > @@ -14,6 +14,7 @@ export CROSS_COMPILE = "${TARGET_PREFIX}" > > export KBUILD_OUTPUT = "${STAGING_KERNEL_BUILDDIR}" > > > > export KERNEL_VERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-abiversion')}" > > +export LOCALVERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-localversion')}" > > KERNEL_OBJECT_SUFFIX = ".ko" > > > > # kernel modules are generally machine specific > > diff --git a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb > > index f6f47cfff5..8727d003f9 100644 > > --- a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb > > +++ b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb > > @@ -21,6 +21,9 @@ DEPENDS += "gmp-native" > > EXTRA_OEMAKE = " HOSTCC="${BUILD_CC} ${BUILD_CFLAGS} ${BUILD_LDFLAGS}" HOSTCPP="${BUILD_CPP}"" > > EXTRA_OEMAKE += " HOSTCXX="${BUILD_CXX} ${BUILD_CXXFLAGS} ${BUILD_LDFLAGS}" CROSS_COMPILE=${TARGET_PREFIX}" > > > > +KERNEL_LOCALVERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" > > +export LOCALVERSION="${KERNEL_LOCALVERSION}" > > + > > # Build some host tools under work-shared. CC, LD, and AR are probably > > # not used, but this is the historical way of invoking "make scripts". > > # > > -- > Ryan Eatmon reatmon@ti.com > ----------------------------------------- > Texas Instruments, Inc. - LCPD - MGTS > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#196043): https://lists.openembedded.org/g/openembedded-core/message/196043 > Mute This Topic: https://lists.openembedded.org/mt/104505983/1050810 > Group Owner: openembedded-core+owner@lists.openembedded.org > Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [bruce.ashfield@gmail.com] > -=-=-=-=-=-=-=-=-=-=-=- > -- - Thou shalt not follow the NULL pointer, for chaos and madness await thee at its end - "Use the force Harry" - Gandalf, Star Trek II ^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: [OE-core] [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes 2024-02-22 21:56 ` [OE-core] " Bruce Ashfield @ 2024-02-22 22:46 ` Ryan Eatmon [not found] ` <17B650DBED7FC1F0.14827@lists.openembedded.org> 1 sibling, 0 replies; 8+ messages in thread From: Ryan Eatmon @ 2024-02-22 22:46 UTC (permalink / raw) To: Bruce Ashfield; +Cc: Andreas Helbech Kleist, openembedded-core On 2/22/2024 3:56 PM, Bruce Ashfield wrote: > On Thu, Feb 22, 2024 at 4:51 PM Ryan Eatmon via lists.openembedded.org > <reatmon=ti.com@lists.openembedded.org> wrote: >> >> >> >> On 2/22/2024 4:35 AM, Andreas Helbech Kleist wrote: >>> From: Bruce Ashfield <bruce.ashfield@gmail.com> >>> >>> The initial fix for localversion setting in 6.3+ broke older >>> recipes and also broke recipes setting localversion in a kernel >>> recipe, as make-mod-scripts (and other locations) can trigger >>> a regeneration of files and don't have access to the variable. >>> >>> Moving the setting of this variable to the global namespace >>> doesn't make sense, so we follow the example of the kernel-abiversion >>> and save a kernel-localversion to the build artifacts. >>> >>> Recipes that may regenerate scripts/dynamic files, must >>> depend on the do_shared_workedir of the kernel and use the helper >>> function to read the file storing the localversion. >>> >>> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> >>> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> >>> >>> cherry-picked from master b378eec156998eea55ba61e59103cb34fab0d07c >>> >>> Signed-off-by: Andreas Helbech Kleist <andreaskleist@gmail.com> >> >> I'm not sure what is going on with our meta-ti testing. This set of >> changes causes the same issue we were seeing before. Plus, now that I'm >> looking into it deeper, I'm seeing a breakage in master related to these >> same patches on there. Not sure why the changes were not caught in our >> testing on master back when the patches were accepted there... Clearly >> I need some better checks on the images as part of our QC process... >> >> I need to figure out how to fix the issue on master and see if the same >> change can be applied to these patches on kirkstone. I'll try and get >> all this done as quickly as I can. > > Please make sure to copy me directly, both as the maintainer of the > parts of core in question and the author of the patches. > > We've had no reports of issues since any of these went in, and they > aren't exactly a recent change. Which obviously means there's > potentially something different in the environment or the kernel > recipes. > > If you get a set of reproducing steps with linux-yocto and core, I > can lend a hand with any fixes. > > Bruce This may not be an issue with these patches per se. It may be an issue with our kernel recipes in meta-ti. But since kirkstone is our primary release vector right now, it is breaking us to accept these patches onto kirkstone. I fully acknowledge that this might solely a TI issue. And now that we are aware of the issue we are going to work very very hard to find a solution as quickly as we can. As soon as we have an understanding of how to recreate the issue outside of our recipe we will definitely share with this thread. >> >> >> >>> --- >>> meta/classes/kernel-arch.bbclass | 8 -------- >>> meta/classes/kernel.bbclass | 14 ++++++++++++++ >>> meta/classes/kernelsrc.bbclass | 1 + >>> meta/classes/linux-kernel-base.bbclass | 11 +++++++++++ >>> meta/classes/module-base.bbclass | 1 + >>> .../make-mod-scripts/make-mod-scripts_1.0.bb | 3 +++ >>> 6 files changed, 30 insertions(+), 8 deletions(-) >>> >>> diff --git a/meta/classes/kernel-arch.bbclass b/meta/classes/kernel-arch.bbclass >>> index 0a79dea0af..62c8211621 100644 >>> --- a/meta/classes/kernel-arch.bbclass >>> +++ b/meta/classes/kernel-arch.bbclass >>> @@ -65,11 +65,3 @@ KERNEL_CC = "${CCACHE}${HOST_PREFIX}gcc ${HOST_CC_KERNEL_ARCH} -fuse-ld=bfd ${DE >>> KERNEL_LD = "${CCACHE}${HOST_PREFIX}ld.bfd ${HOST_LD_KERNEL_ARCH}" >>> KERNEL_AR = "${CCACHE}${HOST_PREFIX}ar ${HOST_AR_KERNEL_ARCH}" >>> TOOLCHAIN ?= "gcc" >>> - >>> -# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in >>> -# the local version. Having it empty means nothing will be added, and any >>> -# value will be appended to the local kernel version. This replaces the >>> -# use of .scmversion file for setting a localversion without using >>> -# the CONFIG_LOCALVERSION option. >>> -KERNEL_LOCALVERSION ??= "" >>> -export LOCALVERSION ?= "${KERNEL_LOCALVERSION}" >>> diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass >>> index 940f1a3cf4..96e41b5192 100644 >>> --- a/meta/classes/kernel.bbclass >>> +++ b/meta/classes/kernel.bbclass >>> @@ -541,6 +541,7 @@ do_shared_workdir () { >>> # >>> >>> echo "${KERNEL_VERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-abiversion >>> + echo "${KERNEL_LOCALVERSION}" > $kerneldir/${KERNEL_PACKAGE_NAME}-localversion >>> >>> # Copy files required for module builds >>> cp System.map $kerneldir/System.map-${KERNEL_VERSION} >>> @@ -630,6 +631,19 @@ python check_oldest_kernel() { >>> check_oldest_kernel[vardepsexclude] += "OLDEST_KERNEL KERNEL_VERSION" >>> do_configure[prefuncs] += "check_oldest_kernel" >>> >>> +KERNEL_LOCALVERSION ??= "" >>> + >>> +# 6.3+ requires the variable LOCALVERSION to be set to not get a "+" in >>> +# the local version. Having it empty means nothing will be added, and any >>> +# value will be appended to the local kernel version. This replaces the >>> +# use of .scmversion file for setting a localversion without using >>> +# the CONFIG_LOCALVERSION option. >>> +# >>> +# Note: This class saves the value of localversion to a file >>> +# so other recipes like make-mod-scripts can restore it via the >>> +# helper function get_kernellocalversion_file >>> +export LOCALVERSION="${KERNEL_LOCALVERSION}" >>> + >>> kernel_do_configure() { >>> # fixes extra + in /lib/modules/2.6.37+ >>> # $ scripts/setlocalversion . => + >>> diff --git a/meta/classes/kernelsrc.bbclass b/meta/classes/kernelsrc.bbclass >>> index a951ba3325..a79bf18b09 100644 >>> --- a/meta/classes/kernelsrc.bbclass >>> +++ b/meta/classes/kernelsrc.bbclass >>> @@ -5,6 +5,7 @@ do_patch[depends] += "virtual/kernel:do_shared_workdir" >>> do_patch[noexec] = "1" >>> do_package[depends] += "virtual/kernel:do_populate_sysroot" >>> KERNEL_VERSION = "${@get_kernelversion_file("${STAGING_KERNEL_BUILDDIR}")}" >>> +LOCAL_VERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" >>> >>> inherit linux-kernel-base >>> >>> diff --git a/meta/classes/linux-kernel-base.bbclass b/meta/classes/linux-kernel-base.bbclass >>> index 73a6fe36d9..0e2a4a4abe 100644 >>> --- a/meta/classes/linux-kernel-base.bbclass >>> +++ b/meta/classes/linux-kernel-base.bbclass >>> @@ -33,6 +33,17 @@ def get_kernelversion_file(p): >>> except IOError: >>> return None >>> >>> +def get_kernellocalversion_file(p): >>> + fn = p + '/kernel-localversion' >>> + >>> + try: >>> + with open(fn, 'r') as f: >>> + return f.readlines()[0].strip() >>> + except IOError: >>> + return "" >>> + >>> + return "" >>> + >>> def linux_module_packages(s, d): >>> suffix = "" >>> return " ".join(map(lambda s: "kernel-module-%s%s" % (s.lower().replace('_', '-').replace('@', '+'), suffix), s.split())) >>> diff --git a/meta/classes/module-base.bbclass b/meta/classes/module-base.bbclass >>> index 27bd69ff33..5b2fde8144 100644 >>> --- a/meta/classes/module-base.bbclass >>> +++ b/meta/classes/module-base.bbclass >>> @@ -14,6 +14,7 @@ export CROSS_COMPILE = "${TARGET_PREFIX}" >>> export KBUILD_OUTPUT = "${STAGING_KERNEL_BUILDDIR}" >>> >>> export KERNEL_VERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-abiversion')}" >>> +export LOCALVERSION = "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-localversion')}" >>> KERNEL_OBJECT_SUFFIX = ".ko" >>> >>> # kernel modules are generally machine specific >>> diff --git a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb >>> index f6f47cfff5..8727d003f9 100644 >>> --- a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb >>> +++ b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb >>> @@ -21,6 +21,9 @@ DEPENDS += "gmp-native" >>> EXTRA_OEMAKE = " HOSTCC="${BUILD_CC} ${BUILD_CFLAGS} ${BUILD_LDFLAGS}" HOSTCPP="${BUILD_CPP}"" >>> EXTRA_OEMAKE += " HOSTCXX="${BUILD_CXX} ${BUILD_CXXFLAGS} ${BUILD_LDFLAGS}" CROSS_COMPILE=${TARGET_PREFIX}" >>> >>> +KERNEL_LOCALVERSION = "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" >>> +export LOCALVERSION="${KERNEL_LOCALVERSION}" >>> + >>> # Build some host tools under work-shared. CC, LD, and AR are probably >>> # not used, but this is the historical way of invoking "make scripts". >>> # >> >> -- >> Ryan Eatmon reatmon@ti.com >> ----------------------------------------- >> Texas Instruments, Inc. - LCPD - MGTS >> >> -=-=-=-=-=-=-=-=-=-=-=- >> Links: You receive all messages sent to this group. >> View/Reply Online (#196043): https://lists.openembedded.org/g/openembedded-core/message/196043 >> Mute This Topic: https://lists.openembedded.org/mt/104505983/1050810 >> Group Owner: openembedded-core+owner@lists.openembedded.org >> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [bruce.ashfield@gmail.com] >> -=-=-=-=-=-=-=-=-=-=-=- >> > > -- Ryan Eatmon reatmon@ti.com ----------------------------------------- Texas Instruments, Inc. - LCPD - MGTS ^ permalink raw reply [flat|nested] 8+ messages in thread
[parent not found: <17B650DBED7FC1F0.14827@lists.openembedded.org>]
* Re: [OE-core] [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes [not found] ` <17B650DBED7FC1F0.14827@lists.openembedded.org> @ 2024-02-23 17:11 ` Ryan Eatmon 0 siblings, 0 replies; 8+ messages in thread From: Ryan Eatmon @ 2024-02-23 17:11 UTC (permalink / raw) To: Bruce Ashfield; +Cc: Andreas Helbech Kleist, openembedded-core On 2/22/2024 4:46 PM, Ryan Eatmon via lists.openembedded.org wrote: > > > On 2/22/2024 3:56 PM, Bruce Ashfield wrote: >> On Thu, Feb 22, 2024 at 4:51 PM Ryan Eatmon via lists.openembedded.org >> <reatmon=ti.com@lists.openembedded.org> wrote: >>> >>> >>> >>> On 2/22/2024 4:35 AM, Andreas Helbech Kleist wrote: >>>> From: Bruce Ashfield <bruce.ashfield@gmail.com> >>>> >>>> The initial fix for localversion setting in 6.3+ broke older >>>> recipes and also broke recipes setting localversion in a kernel >>>> recipe, as make-mod-scripts (and other locations) can trigger >>>> a regeneration of files and don't have access to the variable. >>>> >>>> Moving the setting of this variable to the global namespace >>>> doesn't make sense, so we follow the example of the kernel-abiversion >>>> and save a kernel-localversion to the build artifacts. >>>> >>>> Recipes that may regenerate scripts/dynamic files, must >>>> depend on the do_shared_workedir of the kernel and use the helper >>>> function to read the file storing the localversion. >>>> >>>> Signed-off-by: Bruce Ashfield <bruce.ashfield@gmail.com> >>>> Signed-off-by: Alexandre Belloni <alexandre.belloni@bootlin.com> >>>> >>>> cherry-picked from master b378eec156998eea55ba61e59103cb34fab0d07c >>>> >>>> Signed-off-by: Andreas Helbech Kleist <andreaskleist@gmail.com> >>> >>> I'm not sure what is going on with our meta-ti testing. This set of >>> changes causes the same issue we were seeing before. Plus, now that I'm >>> looking into it deeper, I'm seeing a breakage in master related to these >>> same patches on there. Not sure why the changes were not caught in our >>> testing on master back when the patches were accepted there... Clearly >>> I need some better checks on the images as part of our QC process... >>> >>> I need to figure out how to fix the issue on master and see if the same >>> change can be applied to these patches on kirkstone. I'll try and get >>> all this done as quickly as I can. >> >> Please make sure to copy me directly, both as the maintainer of the >> parts of core in question and the author of the patches. >> >> We've had no reports of issues since any of these went in, and they >> aren't exactly a recent change. Which obviously means there's >> potentially something different in the environment or the kernel >> recipes. >> >> If you get a set of reproducing steps with linux-yocto and core, I >> can lend a hand with any fixes. >> >> Bruce > > This may not be an issue with these patches per se. It may be an issue > with our kernel recipes in meta-ti. But since kirkstone is our primary > release vector right now, it is breaking us to accept these patches onto > kirkstone. I fully acknowledge that this might solely a TI issue. And > now that we are aware of the issue we are going to work very very hard > to find a solution as quickly as we can. > > As soon as we have an understanding of how to recreate the issue outside > of our recipe we will definitely share with this thread. > Ok. My initial thinking that there was a problem was incorrect. I looked at the file system and found our value for KERNEL_LOCALVERSION was included in the modules directory name twice. /lib/modules/6.1.69-gcb84067eaf83-gcb84067eaf83 That was the symptom that caused the issue with our request for the revert last week. However, with this full patch series the problem caused by the double entry from the last series is not a problem because the double entry is everywhere in the kernel, so it all works together. It's just goofy. So with that. This bigger series can be accepted into Kirkstone. Acked-by: Ryan Eatmon <reatmon@ti.com> Now for the second issue, and maybe this was known that it would occur, if we set KERNEL_LOCALVERSION it is placed into both the .scmversion file AND the LOCALVERSION variable. The setlocalversion script in the 6.1 kernel we are currently pointing at for our production includes both in the version string, which causes the entire kernel to be named named with a redundant string. /lib/modules/6.1.69-gcb84067eaf83-gcb84067eaf83 I guess we can live with this. It is unnecessary, but not incorrect. It is cleaned up with the next LTS kernel 6.6. This is just the hazard of only having a single class to handle kernel issues that needs to span multiple kernel versions that are changing things up in big ways. The only way I can see to fix it would be to create some new control variables that recipes can set to control the above behavior and then set defaults for them. But we can look into patches to add that if needed. Apologies for taking so much time in testing this series. We are just about to make a release and things that break the kernel cause us a lot anxiety. >>> >>> >>> >>>> --- >>>> meta/classes/kernel-arch.bbclass | 8 -------- >>>> meta/classes/kernel.bbclass | 14 >>>> ++++++++++++++ >>>> meta/classes/kernelsrc.bbclass | 1 + >>>> meta/classes/linux-kernel-base.bbclass | 11 +++++++++++ >>>> meta/classes/module-base.bbclass | 1 + >>>> .../make-mod-scripts/make-mod-scripts_1.0.bb | 3 +++ >>>> 6 files changed, 30 insertions(+), 8 deletions(-) >>>> >>>> diff --git a/meta/classes/kernel-arch.bbclass >>>> b/meta/classes/kernel-arch.bbclass >>>> index 0a79dea0af..62c8211621 100644 >>>> --- a/meta/classes/kernel-arch.bbclass >>>> +++ b/meta/classes/kernel-arch.bbclass >>>> @@ -65,11 +65,3 @@ KERNEL_CC = "${CCACHE}${HOST_PREFIX}gcc >>>> ${HOST_CC_KERNEL_ARCH} -fuse-ld=bfd ${DE >>>> KERNEL_LD = "${CCACHE}${HOST_PREFIX}ld.bfd ${HOST_LD_KERNEL_ARCH}" >>>> KERNEL_AR = "${CCACHE}${HOST_PREFIX}ar ${HOST_AR_KERNEL_ARCH}" >>>> TOOLCHAIN ?= "gcc" >>>> - >>>> -# 6.3+ requires the variable LOCALVERSION to be set to not get a >>>> "+" in >>>> -# the local version. Having it empty means nothing will be added, >>>> and any >>>> -# value will be appended to the local kernel version. This replaces >>>> the >>>> -# use of .scmversion file for setting a localversion without using >>>> -# the CONFIG_LOCALVERSION option. >>>> -KERNEL_LOCALVERSION ??= "" >>>> -export LOCALVERSION ?= "${KERNEL_LOCALVERSION}" >>>> diff --git a/meta/classes/kernel.bbclass b/meta/classes/kernel.bbclass >>>> index 940f1a3cf4..96e41b5192 100644 >>>> --- a/meta/classes/kernel.bbclass >>>> +++ b/meta/classes/kernel.bbclass >>>> @@ -541,6 +541,7 @@ do_shared_workdir () { >>>> # >>>> >>>> echo "${KERNEL_VERSION}" > >>>> $kerneldir/${KERNEL_PACKAGE_NAME}-abiversion >>>> + echo "${KERNEL_LOCALVERSION}" > >>>> $kerneldir/${KERNEL_PACKAGE_NAME}-localversion >>>> >>>> # Copy files required for module builds >>>> cp System.map $kerneldir/System.map-${KERNEL_VERSION} >>>> @@ -630,6 +631,19 @@ python check_oldest_kernel() { >>>> check_oldest_kernel[vardepsexclude] += "OLDEST_KERNEL >>>> KERNEL_VERSION" >>>> do_configure[prefuncs] += "check_oldest_kernel" >>>> >>>> +KERNEL_LOCALVERSION ??= "" >>>> + >>>> +# 6.3+ requires the variable LOCALVERSION to be set to not get a >>>> "+" in >>>> +# the local version. Having it empty means nothing will be added, >>>> and any >>>> +# value will be appended to the local kernel version. This replaces >>>> the >>>> +# use of .scmversion file for setting a localversion without using >>>> +# the CONFIG_LOCALVERSION option. >>>> +# >>>> +# Note: This class saves the value of localversion to a file >>>> +# so other recipes like make-mod-scripts can restore it via the >>>> +# helper function get_kernellocalversion_file >>>> +export LOCALVERSION="${KERNEL_LOCALVERSION}" >>>> + >>>> kernel_do_configure() { >>>> # fixes extra + in /lib/modules/2.6.37+ >>>> # $ scripts/setlocalversion . => + >>>> diff --git a/meta/classes/kernelsrc.bbclass >>>> b/meta/classes/kernelsrc.bbclass >>>> index a951ba3325..a79bf18b09 100644 >>>> --- a/meta/classes/kernelsrc.bbclass >>>> +++ b/meta/classes/kernelsrc.bbclass >>>> @@ -5,6 +5,7 @@ do_patch[depends] += "virtual/kernel:do_shared_workdir" >>>> do_patch[noexec] = "1" >>>> do_package[depends] += "virtual/kernel:do_populate_sysroot" >>>> KERNEL_VERSION = >>>> "${@get_kernelversion_file("${STAGING_KERNEL_BUILDDIR}")}" >>>> +LOCAL_VERSION = >>>> "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" >>>> >>>> inherit linux-kernel-base >>>> >>>> diff --git a/meta/classes/linux-kernel-base.bbclass >>>> b/meta/classes/linux-kernel-base.bbclass >>>> index 73a6fe36d9..0e2a4a4abe 100644 >>>> --- a/meta/classes/linux-kernel-base.bbclass >>>> +++ b/meta/classes/linux-kernel-base.bbclass >>>> @@ -33,6 +33,17 @@ def get_kernelversion_file(p): >>>> except IOError: >>>> return None >>>> >>>> +def get_kernellocalversion_file(p): >>>> + fn = p + '/kernel-localversion' >>>> + >>>> + try: >>>> + with open(fn, 'r') as f: >>>> + return f.readlines()[0].strip() >>>> + except IOError: >>>> + return "" >>>> + >>>> + return "" >>>> + >>>> def linux_module_packages(s, d): >>>> suffix = "" >>>> return " ".join(map(lambda s: "kernel-module-%s%s" % >>>> (s.lower().replace('_', '-').replace('@', '+'), suffix), s.split())) >>>> diff --git a/meta/classes/module-base.bbclass >>>> b/meta/classes/module-base.bbclass >>>> index 27bd69ff33..5b2fde8144 100644 >>>> --- a/meta/classes/module-base.bbclass >>>> +++ b/meta/classes/module-base.bbclass >>>> @@ -14,6 +14,7 @@ export CROSS_COMPILE = "${TARGET_PREFIX}" >>>> export KBUILD_OUTPUT = "${STAGING_KERNEL_BUILDDIR}" >>>> >>>> export KERNEL_VERSION = >>>> "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-abiversion')}" >>>> +export LOCALVERSION = >>>> "${@oe.utils.read_file('${STAGING_KERNEL_BUILDDIR}/kernel-localversion')}" >>>> KERNEL_OBJECT_SUFFIX = ".ko" >>>> >>>> # kernel modules are generally machine specific >>>> diff --git >>>> a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb >>>> b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb >>>> index f6f47cfff5..8727d003f9 100644 >>>> --- a/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb >>>> +++ b/meta/recipes-kernel/make-mod-scripts/make-mod-scripts_1.0.bb >>>> @@ -21,6 +21,9 @@ DEPENDS += "gmp-native" >>>> EXTRA_OEMAKE = " HOSTCC="${BUILD_CC} ${BUILD_CFLAGS} >>>> ${BUILD_LDFLAGS}" HOSTCPP="${BUILD_CPP}"" >>>> EXTRA_OEMAKE += " HOSTCXX="${BUILD_CXX} ${BUILD_CXXFLAGS} >>>> ${BUILD_LDFLAGS}" CROSS_COMPILE=${TARGET_PREFIX}" >>>> >>>> +KERNEL_LOCALVERSION = >>>> "${@get_kernellocalversion_file("${STAGING_KERNEL_BUILDDIR}")}" >>>> +export LOCALVERSION="${KERNEL_LOCALVERSION}" >>>> + >>>> # Build some host tools under work-shared. CC, LD, and AR are >>>> probably >>>> # not used, but this is the historical way of invoking "make >>>> scripts". >>>> # >>> >>> -- >>> Ryan Eatmon reatmon@ti.com >>> ----------------------------------------- >>> Texas Instruments, Inc. - LCPD - MGTS >>> >>> >>> >> >> > > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#196045): https://lists.openembedded.org/g/openembedded-core/message/196045 > Mute This Topic: https://lists.openembedded.org/mt/104505983/6551054 > Group Owner: openembedded-core+owner@lists.openembedded.org > Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [reatmon@ti.com] > -=-=-=-=-=-=-=-=-=-=-=- > -- Ryan Eatmon reatmon@ti.com ----------------------------------------- Texas Instruments, Inc. - LCPD - MGTS ^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2024-02-23 17:11 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-02-22 10:35 [kirkstone][PATCH 0/3] kernel: Backport v6.3+ localversion fixes Andreas Helbech Kleist
2024-02-22 10:35 ` [kirkstone][PATCH 1/3] kernel.bbclass: introduce KERNEL_LOCALVERSION Andreas Helbech Kleist
2024-02-22 10:35 ` [kirkstone][PATCH 2/3] kernel: fix localversion in v6.3+ Andreas Helbech Kleist
2024-02-22 10:35 ` [kirkstone][PATCH 3/3] kernel: make LOCALVERSION consistent between recipes Andreas Helbech Kleist
2024-02-22 21:51 ` Ryan Eatmon
2024-02-22 21:56 ` [OE-core] " Bruce Ashfield
2024-02-22 22:46 ` Ryan Eatmon
[not found] ` <17B650DBED7FC1F0.14827@lists.openembedded.org>
2024-02-23 17:11 ` Ryan Eatmon
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox