* [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error @ 2023-10-31 14:04 Ryan Eatmon 2023-10-31 14:04 ` [meta-arago][master/kirkstone][PATCH 2/2] tisdk-core-bundle: Add the tiny image into the core bundle Ryan Eatmon 2023-10-31 15:44 ` [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error Denys Dmytriyenko 0 siblings, 2 replies; 14+ messages in thread From: Ryan Eatmon @ 2023-10-31 14:04 UTC (permalink / raw) To: Praneeth Bajjuri, Denys Dmytriyenko, meta-arago We want to add an image into the core bundle, but that image does not have any opkg .control files. tar apparently errors out if you ask it to extract out files but the files are not in the archive, and the recipes are setup that if any of the commands in the shell error out, then the entire recipe fails. Simple fix, add an || (or) condition to the tar command to print a message that there were not any control files instead of erroring out. Signed-off-by: Ryan Eatmon <reatmon@ti.com> --- meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass index 14d14f08..b9c63610 100644 --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass @@ -405,10 +405,10 @@ sw_manifest_target() { # Only extract tar.gz or tar.bz2 types if [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] then - tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control + tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" elif [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] then - tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control + tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" fi done -- 2.17.1 ^ permalink raw reply related [flat|nested] 14+ messages in thread
* [meta-arago][master/kirkstone][PATCH 2/2] tisdk-core-bundle: Add the tiny image into the core bundle 2023-10-31 14:04 [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error Ryan Eatmon @ 2023-10-31 14:04 ` Ryan Eatmon 2023-10-31 15:44 ` [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error Denys Dmytriyenko 1 sibling, 0 replies; 14+ messages in thread From: Ryan Eatmon @ 2023-10-31 14:04 UTC (permalink / raw) To: Praneeth Bajjuri, Denys Dmytriyenko, meta-arago Add the tisdk-tiny-image into the core bundle. Signed-off-by: Ryan Eatmon <reatmon@ti.com> --- meta-arago-distro/recipes-core/images/tisdk-core-bundle.inc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta-arago-distro/recipes-core/images/tisdk-core-bundle.inc b/meta-arago-distro/recipes-core/images/tisdk-core-bundle.inc index 43b1ef5f..2b80ba4e 100644 --- a/meta-arago-distro/recipes-core/images/tisdk-core-bundle.inc +++ b/meta-arago-distro/recipes-core/images/tisdk-core-bundle.inc @@ -29,7 +29,7 @@ DTB_FILTER:j7200 = "j7200" DTB_FILTER:j721s2 = "j721s2" # List of target side images to build for the SDK -TARGET_IMAGES = "tisdk-base-image tisdk-default-image tisdk-thinlinux-image tisdk-bootstrap-image" +TARGET_IMAGES = "tisdk-base-image tisdk-default-image tisdk-thinlinux-image tisdk-bootstrap-image tisdk-tiny-image" TISDK_TOOLCHAIN = "meta-toolchain-arago-tisdk" TOOLCHAIN_SUFFIX = "-tisdk" -- 2.17.1 ^ permalink raw reply related [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-10-31 14:04 [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error Ryan Eatmon 2023-10-31 14:04 ` [meta-arago][master/kirkstone][PATCH 2/2] tisdk-core-bundle: Add the tiny image into the core bundle Ryan Eatmon @ 2023-10-31 15:44 ` Denys Dmytriyenko 2023-10-31 15:59 ` Ryan Eatmon 1 sibling, 1 reply; 14+ messages in thread From: Denys Dmytriyenko @ 2023-10-31 15:44 UTC (permalink / raw) To: reatmon; +Cc: Praneeth Bajjuri, Denys Dmytriyenko, meta-arago On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via lists.yoctoproject.org wrote: > We want to add an image into the core bundle, but that image does not > have any opkg .control files. tar apparently errors out if you ask it > to extract out files but the files are not in the archive, and the > recipes are setup that if any of the commands in the shell error out, > then the entire recipe fails. > > Simple fix, add an || (or) condition to the tar command to print a > message that there were not any control files instead of erroring out. So, simply bypassing tar error due to missing *.control files still won't enable you to properly generate the SW manifest. As those *.control files from individual packages are parsed to extract the license information. And they are missing because tiny image specifically disables "package management" to save on space. Therefore tiny image was not included in the bundle, since it doesn't generate the SW manifest. > Signed-off-by: Ryan Eatmon <reatmon@ti.com> > --- > meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > 1 file changed, 2 insertions(+), 2 deletions(-) > > diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > index 14d14f08..b9c63610 100644 > --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > @@ -405,10 +405,10 @@ sw_manifest_target() { > # Only extract tar.gz or tar.bz2 types > if [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > then > - tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control > + tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" > elif [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > then > - tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control > + tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" > fi > done > > -- > 2.17.1 ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-10-31 15:44 ` [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error Denys Dmytriyenko @ 2023-10-31 15:59 ` Ryan Eatmon 2023-10-31 19:03 ` Denys Dmytriyenko 2023-11-02 11:48 ` [EXTERNAL] " Chirag Shilwant 0 siblings, 2 replies; 14+ messages in thread From: Ryan Eatmon @ 2023-10-31 15:59 UTC (permalink / raw) To: Denys Dmytriyenko; +Cc: Praneeth Bajjuri, Denys Dmytriyenko, meta-arago On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via lists.yoctoproject.org wrote: >> We want to add an image into the core bundle, but that image does not >> have any opkg .control files. tar apparently errors out if you ask it >> to extract out files but the files are not in the archive, and the >> recipes are setup that if any of the commands in the shell error out, >> then the entire recipe fails. >> >> Simple fix, add an || (or) condition to the tar command to print a >> message that there were not any control files instead of erroring out. > > So, simply bypassing tar error due to missing *.control files still won't > enable you to properly generate the SW manifest. As those *.control files > from individual packages are parsed to extract the license information. > And they are missing because tiny image specifically disables "package > management" to save on space. Therefore tiny image was not included in > the bundle, since it doesn't generate the SW manifest. And this is why I sent the patch in rather than just taking it. This patch was a response to Chirag running in the above error when trying to add the tiny image into the core bundle in the processor sdk. So, why do we want to add tiny to the bundle? Since tiny should be a subset of the other images, is there anything not covered in the software manifest that should prevent this patch? > >> Signed-off-by: Ryan Eatmon <reatmon@ti.com> >> --- >> meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- >> 1 file changed, 2 insertions(+), 2 deletions(-) >> >> diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >> index 14d14f08..b9c63610 100644 >> --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >> +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >> @@ -405,10 +405,10 @@ sw_manifest_target() { >> # Only extract tar.gz or tar.bz2 types >> if [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] >> then >> - tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control >> + tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" >> elif [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] >> then >> - tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control >> + tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" >> fi >> done >> >> -- >> 2.17.1 -- Ryan Eatmon reatmon@ti.com ----------------------------------------- Texas Instruments, Inc. - LCPD - MGTS ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-10-31 15:59 ` Ryan Eatmon @ 2023-10-31 19:03 ` Denys Dmytriyenko 2023-11-02 11:48 ` [EXTERNAL] " Chirag Shilwant 1 sibling, 0 replies; 14+ messages in thread From: Denys Dmytriyenko @ 2023-10-31 19:03 UTC (permalink / raw) To: Ryan Eatmon; +Cc: Praneeth Bajjuri, Denys Dmytriyenko, meta-arago On Tue, Oct 31, 2023 at 10:59:43AM -0500, Ryan Eatmon wrote: > > > On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > >On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via lists.yoctoproject.org wrote: > >>We want to add an image into the core bundle, but that image does not > >>have any opkg .control files. tar apparently errors out if you ask it > >>to extract out files but the files are not in the archive, and the > >>recipes are setup that if any of the commands in the shell error out, > >>then the entire recipe fails. > >> > >>Simple fix, add an || (or) condition to the tar command to print a > >>message that there were not any control files instead of erroring out. > > > >So, simply bypassing tar error due to missing *.control files still won't > >enable you to properly generate the SW manifest. As those *.control files > >from individual packages are parsed to extract the license information. > >And they are missing because tiny image specifically disables "package > >management" to save on space. Therefore tiny image was not included in > >the bundle, since it doesn't generate the SW manifest. > > And this is why I sent the patch in rather than just taking it. > This patch was a response to Chirag running in the above error when > trying to add the tiny image into the core bundle in the processor > sdk. > > So, why do we want to add tiny to the bundle? Since tiny should be > a subset of the other images, is there anything not covered in the > software manifest that should prevent this patch? That is the risk, yes. Right now it is just core-boot packagegroup with efi-grub and kernel removed. But I see someone is trying to submit a patch to add extra packages to that packagegroup, so the licensing can eventually change and easily go unnoticed. > >>Signed-off-by: Ryan Eatmon <reatmon@ti.com> > >>--- > >> meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > >> 1 file changed, 2 insertions(+), 2 deletions(-) > >> > >>diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > >>index 14d14f08..b9c63610 100644 > >>--- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > >>+++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > >>@@ -405,10 +405,10 @@ sw_manifest_target() { > >> # Only extract tar.gz or tar.bz2 types You might want to update the comment from tar.bz2 to tar.xz > >> if [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > >> then > >>- tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control > >>+ tar xJf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" > >> elif [ -e ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > >> then > >>- tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control > >>+ tar xzf ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control files found in ${image}" > >> fi > >> done > >>-- > >>2.17.1 ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [EXTERNAL] Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-10-31 15:59 ` Ryan Eatmon 2023-10-31 19:03 ` Denys Dmytriyenko @ 2023-11-02 11:48 ` Chirag Shilwant 2023-11-02 20:37 ` Bin Liu 1 sibling, 1 reply; 14+ messages in thread From: Chirag Shilwant @ 2023-11-02 11:48 UTC (permalink / raw) To: reatmon, Denys Dmytriyenko, b-liu Cc: Praneeth Bajjuri, Denys Dmytriyenko, meta-arago Hi Ryan, On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: > > > On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: >> On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via >> lists.yoctoproject.org wrote: >>> We want to add an image into the core bundle, but that image does not >>> have any opkg .control files. tar apparently errors out if you ask it >>> to extract out files but the files are not in the archive, and the >>> recipes are setup that if any of the commands in the shell error out, >>> then the entire recipe fails. >>> >>> Simple fix, add an || (or) condition to the tar command to print a >>> message that there were not any control files instead of erroring out. >> >> So, simply bypassing tar error due to missing *.control files still >> won't >> enable you to properly generate the SW manifest. As those *.control >> files >> from individual packages are parsed to extract the license information. >> And they are missing because tiny image specifically disables "package >> management" to save on space. Therefore tiny image was not included in >> the bundle, since it doesn't generate the SW manifest. > > And this is why I sent the patch in rather than just taking it. This > patch was a response to Chirag running in the above error when trying > to add the tiny image into the core bundle in the processor sdk. > > So, why do we want to add tiny to the bundle? We got a requirement from Bin Liu to add tiny-image in /board-support/prebuilt-images/ of the SDK bundle. I'm not sure about the "why do we want it to the bundle" part. Adding Bin to provide more insights on the requirement part. Regards, Chirag > Since tiny should be a subset of the other images, is there anything > not covered in the software manifest that should prevent this patch? > >> >>> Signed-off-by: Ryan Eatmon <reatmon@ti.com> >>> --- >>> meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- >>> 1 file changed, 2 insertions(+), 2 deletions(-) >>> >>> diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>> b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>> index 14d14f08..b9c63610 100644 >>> --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>> +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>> @@ -405,10 +405,10 @@ sw_manifest_target() { >>> # Only extract tar.gz or tar.bz2 types >>> if [ -e >>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] >>> then >>> - tar xJf >>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C >>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control >>> + tar xJf >>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C >>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control >>> files found in ${image}" >>> elif [ -e >>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] >>> then >>> - tar xzf >>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C >>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control >>> + tar xzf >>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C >>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No control >>> files found in ${image}" >>> fi >>> done >>> -- >>> 2.17.1 > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-02 11:48 ` [EXTERNAL] " Chirag Shilwant @ 2023-11-02 20:37 ` Bin Liu 2023-11-03 13:54 ` Bin Liu ` (2 more replies) 0 siblings, 3 replies; 14+ messages in thread From: Bin Liu @ 2023-11-02 20:37 UTC (permalink / raw) To: Chirag Shilwant Cc: reatmon, Denys Dmytriyenko, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago Hi, On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: > Hi Ryan, > > On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: > > > > > > On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > > > On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via > > > lists.yoctoproject.org wrote: > > > > We want to add an image into the core bundle, but that image does not > > > > have any opkg .control files. tar apparently errors out if you ask it > > > > to extract out files but the files are not in the archive, and the > > > > recipes are setup that if any of the commands in the shell error out, > > > > then the entire recipe fails. > > > > > > > > Simple fix, add an || (or) condition to the tar command to print a > > > > message that there were not any control files instead of erroring out. > > > > > > So, simply bypassing tar error due to missing *.control files still > > > won't > > > enable you to properly generate the SW manifest. As those *.control > > > files > > > from individual packages are parsed to extract the license information. > > > And they are missing because tiny image specifically disables "package > > > management" to save on space. Therefore tiny image was not included in > > > the bundle, since it doesn't generate the SW manifest. > > > > And this is why I sent the patch in rather than just taking it. This > > patch was a response to Chirag running in the above error when trying to > > add the tiny image into the core bundle in the processor sdk. > > > > So, why do we want to add tiny to the bundle? > > > We got a requirement from Bin Liu to add tiny-image in > /board-support/prebuilt-images/ of the SDK bundle. > I'm not sure about the "why do we want it to the bundle" part. Adding Bin to > provide more insights on the requirement part. The tiny image is very small and uses SysVInit. It has been used in many use cases, initramfs is the most important one as far as I am aware. -Bin. > > Regards, > Chirag > > > Since tiny should be a subset of the other images, is there anything > > not covered in the software manifest that should prevent this patch? > > > > > > > > > Signed-off-by: Ryan Eatmon <reatmon@ti.com> > > > > --- > > > > meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > > > > 1 file changed, 2 insertions(+), 2 deletions(-) > > > > > > > > diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > index 14d14f08..b9c63610 100644 > > > > --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > @@ -405,10 +405,10 @@ sw_manifest_target() { > > > > # Only extract tar.gz or tar.bz2 types > > > > if [ -e > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > > > > then > > > > - tar xJf > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > + tar xJf > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > control files found in ${image}" > > > > elif [ -e > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > > > > then > > > > - tar xzf > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > + tar xzf > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > control files found in ${image}" > > > > fi > > > > done > > > > -- > > > > 2.17.1 > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-02 20:37 ` Bin Liu @ 2023-11-03 13:54 ` Bin Liu 2023-11-03 14:25 ` [EXTERNAL] " Bin Liu 2023-11-03 16:18 ` Ryan Eatmon 2 siblings, 0 replies; 14+ messages in thread From: Bin Liu @ 2023-11-03 13:54 UTC (permalink / raw) To: Chirag Shilwant Cc: reatmon, Denys Dmytriyenko, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago Resend my response after subscribed to the mailinglist. -Bin. On Thu, Nov 02, 2023 at 03:37:03PM -0500, Bin Liu wrote: > Hi, > > On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: > > Hi Ryan, > > > > On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: > > > > > > > > > On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > > > > On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via > > > > lists.yoctoproject.org wrote: > > > > > We want to add an image into the core bundle, but that image does not > > > > > have any opkg .control files. tar apparently errors out if you ask it > > > > > to extract out files but the files are not in the archive, and the > > > > > recipes are setup that if any of the commands in the shell error out, > > > > > then the entire recipe fails. > > > > > > > > > > Simple fix, add an || (or) condition to the tar command to print a > > > > > message that there were not any control files instead of erroring out. > > > > > > > > So, simply bypassing tar error due to missing *.control files still > > > > won't > > > > enable you to properly generate the SW manifest. As those *.control > > > > files > > > > from individual packages are parsed to extract the license information. > > > > And they are missing because tiny image specifically disables "package > > > > management" to save on space. Therefore tiny image was not included in > > > > the bundle, since it doesn't generate the SW manifest. > > > > > > And this is why I sent the patch in rather than just taking it. This > > > patch was a response to Chirag running in the above error when trying to > > > add the tiny image into the core bundle in the processor sdk. > > > > > > So, why do we want to add tiny to the bundle? > > > > > > We got a requirement from Bin Liu to add tiny-image in > > /board-support/prebuilt-images/ of the SDK bundle. > > I'm not sure about the "why do we want it to the bundle" part. Adding Bin to > > provide more insights on the requirement part. > > The tiny image is very small and uses SysVInit. It has been used in many > use cases, initramfs is the most important one as far as I am aware. > > -Bin. > > > > > Regards, > > Chirag > > > > > Since tiny should be a subset of the other images, is there anything > > > not covered in the software manifest that should prevent this patch? > > > > > > > > > > > > Signed-off-by: Ryan Eatmon <reatmon@ti.com> > > > > > --- > > > > > meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > > > > > 1 file changed, 2 insertions(+), 2 deletions(-) > > > > > > > > > > diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > index 14d14f08..b9c63610 100644 > > > > > --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > @@ -405,10 +405,10 @@ sw_manifest_target() { > > > > > # Only extract tar.gz or tar.bz2 types > > > > > if [ -e > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > > > > > then > > > > > - tar xJf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > > + tar xJf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > > control files found in ${image}" > > > > > elif [ -e > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > > > > > then > > > > > - tar xzf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > > + tar xzf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > > control files found in ${image}" > > > > > fi > > > > > done > > > > > -- > > > > > 2.17.1 > > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [EXTERNAL] Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-02 20:37 ` Bin Liu 2023-11-03 13:54 ` Bin Liu @ 2023-11-03 14:25 ` Bin Liu 2023-11-03 16:18 ` Ryan Eatmon 2 siblings, 0 replies; 14+ messages in thread From: Bin Liu @ 2023-11-03 14:25 UTC (permalink / raw) To: Chirag Shilwant Cc: reatmon, Denys Dmytriyenko, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago Resend my response after subscribed to the mailinglist. -Bin. On Thu, Nov 02, 2023 at 03:37:03PM -0500, Bin Liu wrote: > Hi, > > On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: > > Hi Ryan, > > > > On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: > > > > > > > > > On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > > > > On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via > > > > lists.yoctoproject.org wrote: > > > > > We want to add an image into the core bundle, but that image does not > > > > > have any opkg .control files. tar apparently errors out if you ask it > > > > > to extract out files but the files are not in the archive, and the > > > > > recipes are setup that if any of the commands in the shell error out, > > > > > then the entire recipe fails. > > > > > > > > > > Simple fix, add an || (or) condition to the tar command to print a > > > > > message that there were not any control files instead of erroring out. > > > > > > > > So, simply bypassing tar error due to missing *.control files still > > > > won't > > > > enable you to properly generate the SW manifest. As those *.control > > > > files > > > > from individual packages are parsed to extract the license information. > > > > And they are missing because tiny image specifically disables "package > > > > management" to save on space. Therefore tiny image was not included in > > > > the bundle, since it doesn't generate the SW manifest. > > > > > > And this is why I sent the patch in rather than just taking it. This > > > patch was a response to Chirag running in the above error when trying to > > > add the tiny image into the core bundle in the processor sdk. > > > > > > So, why do we want to add tiny to the bundle? > > > > > > We got a requirement from Bin Liu to add tiny-image in > > /board-support/prebuilt-images/ of the SDK bundle. > > I'm not sure about the "why do we want it to the bundle" part. Adding Bin to > > provide more insights on the requirement part. > > The tiny image is very small and uses SysVInit. It has been used in many > use cases, initramfs is the most important one as far as I am aware. > > -Bin. > > > > > Regards, > > Chirag > > > > > Since tiny should be a subset of the other images, is there anything > > > not covered in the software manifest that should prevent this patch? > > > > > > > > > > > > Signed-off-by: Ryan Eatmon <reatmon@ti.com> > > > > > --- > > > > > meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > > > > > 1 file changed, 2 insertions(+), 2 deletions(-) > > > > > > > > > > diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > index 14d14f08..b9c63610 100644 > > > > > --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > @@ -405,10 +405,10 @@ sw_manifest_target() { > > > > > # Only extract tar.gz or tar.bz2 types > > > > > if [ -e > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > > > > > then > > > > > - tar xJf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > > + tar xJf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > > control files found in ${image}" > > > > > elif [ -e > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > > > > > then > > > > > - tar xzf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > > + tar xzf > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > > control files found in ${image}" > > > > > fi > > > > > done > > > > > -- > > > > > 2.17.1 > > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [EXTERNAL] Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-02 20:37 ` Bin Liu 2023-11-03 13:54 ` Bin Liu 2023-11-03 14:25 ` [EXTERNAL] " Bin Liu @ 2023-11-03 16:18 ` Ryan Eatmon 2023-11-03 21:17 ` Denys Dmytriyenko 2 siblings, 1 reply; 14+ messages in thread From: Ryan Eatmon @ 2023-11-03 16:18 UTC (permalink / raw) To: Bin Liu, Chirag Shilwant Cc: Denys Dmytriyenko, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago On 11/2/2023 3:37 PM, Bin Liu wrote: > Hi, > > On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: >> Hi Ryan, >> >> On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: >>> >>> >>> On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: >>>> On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via >>>> lists.yoctoproject.org wrote: >>>>> We want to add an image into the core bundle, but that image does not >>>>> have any opkg .control files. tar apparently errors out if you ask it >>>>> to extract out files but the files are not in the archive, and the >>>>> recipes are setup that if any of the commands in the shell error out, >>>>> then the entire recipe fails. >>>>> >>>>> Simple fix, add an || (or) condition to the tar command to print a >>>>> message that there were not any control files instead of erroring out. >>>> >>>> So, simply bypassing tar error due to missing *.control files still >>>> won't >>>> enable you to properly generate the SW manifest. As those *.control >>>> files >>>> from individual packages are parsed to extract the license information. >>>> And they are missing because tiny image specifically disables "package >>>> management" to save on space. Therefore tiny image was not included in >>>> the bundle, since it doesn't generate the SW manifest. >>> >>> And this is why I sent the patch in rather than just taking it. This >>> patch was a response to Chirag running in the above error when trying to >>> add the tiny image into the core bundle in the processor sdk. >>> >>> So, why do we want to add tiny to the bundle? >> >> >> We got a requirement from Bin Liu to add tiny-image in >> /board-support/prebuilt-images/ of the SDK bundle. >> I'm not sure about the "why do we want it to the bundle" part. Adding Bin to >> provide more insights on the requirement part. > > The tiny image is very small and uses SysVInit. It has been used in many > use cases, initramfs is the most important one as far as I am aware. All of the images now use systemd. The issue comes down to license compliance. The core bundle has the requirement to produce a software license manifest for all of the items within the image. That manifest is generated off of the opkg control files. But the tiny image does not have opkg installed as it is not needed for the purpose of that image. So we cannot gather the manifest information from the tiny image. So we have an impossible situation here. We cannot include the tiny image without violation the manifest requirement. And given that the tiny image is mainly meant for wakeup efforts, I don't see a need to include it in the bundle. If someone wants the tiny image, they can always run bitbake and generate it. It should not take that much time given that it contains almost no packages within it. > -Bin. > >> >> Regards, >> Chirag >> >>> Since tiny should be a subset of the other images, is there anything >>> not covered in the software manifest that should prevent this patch? >>> >>>> >>>>> Signed-off-by: Ryan Eatmon <reatmon@ti.com> >>>>> --- >>>>> meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- >>>>> 1 file changed, 2 insertions(+), 2 deletions(-) >>>>> >>>>> diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>> b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>> index 14d14f08..b9c63610 100644 >>>>> --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>> +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>> @@ -405,10 +405,10 @@ sw_manifest_target() { >>>>> # Only extract tar.gz or tar.bz2 types >>>>> if [ -e >>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] >>>>> then >>>>> - tar xJf >>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C >>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control >>>>> + tar xJf >>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C >>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No >>>>> control files found in ${image}" >>>>> elif [ -e >>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] >>>>> then >>>>> - tar xzf >>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C >>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control >>>>> + tar xzf >>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C >>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No >>>>> control files found in ${image}" >>>>> fi >>>>> done >>>>> -- >>>>> 2.17.1 >>> -- Ryan Eatmon reatmon@ti.com ----------------------------------------- Texas Instruments, Inc. - LCPD - MGTS ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-03 16:18 ` Ryan Eatmon @ 2023-11-03 21:17 ` Denys Dmytriyenko 2023-11-07 22:19 ` Bin Liu 0 siblings, 1 reply; 14+ messages in thread From: Denys Dmytriyenko @ 2023-11-03 21:17 UTC (permalink / raw) To: reatmon Cc: Bin Liu, Chirag Shilwant, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago On Fri, Nov 03, 2023 at 11:18:31AM -0500, Ryan Eatmon via lists.yoctoproject.org wrote: > > > On 11/2/2023 3:37 PM, Bin Liu wrote: > >Hi, > > > >On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: > >>Hi Ryan, > >> > >>On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: > >>> > >>> > >>>On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > >>>>On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via > >>>>lists.yoctoproject.org wrote: > >>>>>We want to add an image into the core bundle, but that image does not > >>>>>have any opkg .control files. tar apparently errors out if you ask it > >>>>>to extract out files but the files are not in the archive, and the > >>>>>recipes are setup that if any of the commands in the shell error out, > >>>>>then the entire recipe fails. > >>>>> > >>>>>Simple fix, add an || (or) condition to the tar command to print a > >>>>>message that there were not any control files instead of erroring out. > >>>> > >>>>So, simply bypassing tar error due to missing *.control files still > >>>>won't > >>>>enable you to properly generate the SW manifest. As those *.control > >>>>files > >>>>from individual packages are parsed to extract the license information. > >>>>And they are missing because tiny image specifically disables "package > >>>>management" to save on space. Therefore tiny image was not included in > >>>>the bundle, since it doesn't generate the SW manifest. > >>> > >>>And this is why I sent the patch in rather than just taking it. This > >>>patch was a response to Chirag running in the above error when trying to > >>>add the tiny image into the core bundle in the processor sdk. > >>> > >>>So, why do we want to add tiny to the bundle? > >> > >> > >>We got a requirement from Bin Liu to add tiny-image in > >>/board-support/prebuilt-images/ of the SDK bundle. > >>I'm not sure about the "why do we want it to the bundle" part. Adding Bin to > >>provide more insights on the requirement part. > > > >The tiny image is very small and uses SysVInit. It has been used in many > >use cases, initramfs is the most important one as far as I am aware. > > > All of the images now use systemd. Correction - all of the images in a single build use the same init manager, which by default is systemd. There used to be a hack that would force tiny image to use SysVinit, even when other images use systemd. It was non-standard and problematic, so was removed recently. There is still a way to control init manager for all Arago images by setting ARAGO_SYSVINIT="1" or more directly INIT_MANAGER="sysvinit". But that would affect all images, not just tiny. And if you really want tiny to use SysVinit and other images to use systemd, you have to build them separately and you cannot have tiny in tisdk bundle. > The issue comes down to license compliance. The core bundle has the > requirement to produce a software license manifest for all of the > items within the image. That manifest is generated off of the opkg > control files. But the tiny image does not have opkg installed as > it is not needed for the purpose of that image. So we cannot gather > the manifest information from the tiny image. > > So we have an impossible situation here. We cannot include the tiny > image without violation the manifest requirement. And given that > the tiny image is mainly meant for wakeup efforts, I don't see a > need to include it in the bundle. If someone wants the tiny image, > they can always run bitbake and generate it. It should not take > that much time given that it contains almost no packages within it. > > > >-Bin. > > > >> > >>Regards, > >>Chirag > >> > >>> Since tiny should be a subset of the other images, is there anything > >>>not covered in the software manifest that should prevent this patch? > >>> > >>>> > >>>>>Signed-off-by: Ryan Eatmon <reatmon@ti.com> > >>>>>--- > >>>>> meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > >>>>> 1 file changed, 2 insertions(+), 2 deletions(-) > >>>>> > >>>>>diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > >>>>>b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > >>>>>index 14d14f08..b9c63610 100644 > >>>>>--- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > >>>>>+++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > >>>>>@@ -405,10 +405,10 @@ sw_manifest_target() { > >>>>> # Only extract tar.gz or tar.bz2 types > >>>>> if [ -e > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > >>>>> then > >>>>>- tar xJf > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control > >>>>>+ tar xJf > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > >>>>>control files found in ${image}" > >>>>> elif [ -e > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > >>>>> then > >>>>>- tar xzf > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control > >>>>>+ tar xzf > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > >>>>>control files found in ${image}" > >>>>> fi > >>>>> done > >>>>> -- > >>>>>2.17.1 > >>> ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-03 21:17 ` Denys Dmytriyenko @ 2023-11-07 22:19 ` Bin Liu 2023-11-08 14:12 ` Ryan Eatmon 0 siblings, 1 reply; 14+ messages in thread From: Bin Liu @ 2023-11-07 22:19 UTC (permalink / raw) To: Denys Dmytriyenko Cc: reatmon, Chirag Shilwant, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago Hi, On Fri, Nov 03, 2023 at 05:17:45PM -0400, Denys Dmytriyenko wrote: > On Fri, Nov 03, 2023 at 11:18:31AM -0500, Ryan Eatmon via lists.yoctoproject.org wrote: > > > > > > On 11/2/2023 3:37 PM, Bin Liu wrote: > > >Hi, > > > > > >On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: > > >>Hi Ryan, > > >> > > >>On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: > > >>> > > >>> > > >>>On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > > >>>>On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via > > >>>>lists.yoctoproject.org wrote: > > >>>>>We want to add an image into the core bundle, but that image does not > > >>>>>have any opkg .control files. tar apparently errors out if you ask it > > >>>>>to extract out files but the files are not in the archive, and the > > >>>>>recipes are setup that if any of the commands in the shell error out, > > >>>>>then the entire recipe fails. > > >>>>> > > >>>>>Simple fix, add an || (or) condition to the tar command to print a > > >>>>>message that there were not any control files instead of erroring out. > > >>>> > > >>>>So, simply bypassing tar error due to missing *.control files still > > >>>>won't > > >>>>enable you to properly generate the SW manifest. As those *.control > > >>>>files > > >>>>from individual packages are parsed to extract the license information. > > >>>>And they are missing because tiny image specifically disables "package > > >>>>management" to save on space. Therefore tiny image was not included in > > >>>>the bundle, since it doesn't generate the SW manifest. > > >>> > > >>>And this is why I sent the patch in rather than just taking it. This > > >>>patch was a response to Chirag running in the above error when trying to > > >>>add the tiny image into the core bundle in the processor sdk. > > >>> > > >>>So, why do we want to add tiny to the bundle? > > >> > > >> > > >>We got a requirement from Bin Liu to add tiny-image in > > >>/board-support/prebuilt-images/ of the SDK bundle. > > >>I'm not sure about the "why do we want it to the bundle" part. Adding Bin to > > >>provide more insights on the requirement part. > > > > > >The tiny image is very small and uses SysVInit. It has been used in many > > >use cases, initramfs is the most important one as far as I am aware. > > > > > > All of the images now use systemd. > > Correction - all of the images in a single build use the same init manager, > which by default is systemd. systermd or sysvinit is not a concern, as long as there is a "tiny" image for initramfs use cases. > > There used to be a hack that would force tiny image to use SysVinit, even > when other images use systemd. It was non-standard and problematic, so was > removed recently. > > There is still a way to control init manager for all Arago images by setting > ARAGO_SYSVINIT="1" or more directly INIT_MANAGER="sysvinit". But that would > affect all images, not just tiny. > > And if you really want tiny to use SysVinit and other images to use systemd, > you have to build them separately and you cannot have tiny in tisdk bundle. > > > > The issue comes down to license compliance. The core bundle has the > > requirement to produce a software license manifest for all of the > > items within the image. That manifest is generated off of the opkg > > control files. But the tiny image does not have opkg installed as > > it is not needed for the purpose of that image. So we cannot gather > > the manifest information from the tiny image. > > > > So we have an impossible situation here. We cannot include the tiny > > image without violation the manifest requirement. And given that > > the tiny image is mainly meant for wakeup efforts, I don't see a > > need to include it in the bundle. If someone wants the tiny image, I guess by "wakeup efforts" you meant TI internal consumption? No, customers often used it for custom board bringup. The importance has no difference from the "tiny" image to other FS images in the bundle. -Bin. > > they can always run bitbake and generate it. It should not take > > that much time given that it contains almost no packages within it. > > > > > > >-Bin. > > > > > >> > > >>Regards, > > >>Chirag > > >> > > >>> Since tiny should be a subset of the other images, is there anything > > >>>not covered in the software manifest that should prevent this patch? > > >>> > > >>>> > > >>>>>Signed-off-by: Ryan Eatmon <reatmon@ti.com> > > >>>>>--- > > >>>>> meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > > >>>>> 1 file changed, 2 insertions(+), 2 deletions(-) > > >>>>> > > >>>>>diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > >>>>>b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > >>>>>index 14d14f08..b9c63610 100644 > > >>>>>--- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > >>>>>+++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > >>>>>@@ -405,10 +405,10 @@ sw_manifest_target() { > > >>>>> # Only extract tar.gz or tar.bz2 types > > >>>>> if [ -e > > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > > >>>>> then > > >>>>>- tar xJf > > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control > > >>>>>+ tar xJf > > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > >>>>>control files found in ${image}" > > >>>>> elif [ -e > > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > > >>>>> then > > >>>>>- tar xzf > > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control > > >>>>>+ tar xzf > > >>>>>${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > >>>>>${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > >>>>>control files found in ${image}" > > >>>>> fi > > >>>>> done > > >>>>> -- > > >>>>>2.17.1 > > >>> ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-07 22:19 ` Bin Liu @ 2023-11-08 14:12 ` Ryan Eatmon 2023-11-08 14:21 ` Bin Liu 0 siblings, 1 reply; 14+ messages in thread From: Ryan Eatmon @ 2023-11-08 14:12 UTC (permalink / raw) To: Bin Liu, Denys Dmytriyenko Cc: Chirag Shilwant, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago On 11/7/2023 4:19 PM, Bin Liu wrote: > Hi, > > On Fri, Nov 03, 2023 at 05:17:45PM -0400, Denys Dmytriyenko wrote: >> On Fri, Nov 03, 2023 at 11:18:31AM -0500, Ryan Eatmon via lists.yoctoproject.org wrote: >>> >>> >>> On 11/2/2023 3:37 PM, Bin Liu wrote: >>>> Hi, >>>> >>>> On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: >>>>> Hi Ryan, >>>>> >>>>> On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: >>>>>> >>>>>> >>>>>> On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: >>>>>>> On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via >>>>>>> lists.yoctoproject.org wrote: >>>>>>>> We want to add an image into the core bundle, but that image does not >>>>>>>> have any opkg .control files. tar apparently errors out if you ask it >>>>>>>> to extract out files but the files are not in the archive, and the >>>>>>>> recipes are setup that if any of the commands in the shell error out, >>>>>>>> then the entire recipe fails. >>>>>>>> >>>>>>>> Simple fix, add an || (or) condition to the tar command to print a >>>>>>>> message that there were not any control files instead of erroring out. >>>>>>> >>>>>>> So, simply bypassing tar error due to missing *.control files still >>>>>>> won't >>>>>>> enable you to properly generate the SW manifest. As those *.control >>>>>>> files >>>>>> >from individual packages are parsed to extract the license information. >>>>>>> And they are missing because tiny image specifically disables "package >>>>>>> management" to save on space. Therefore tiny image was not included in >>>>>>> the bundle, since it doesn't generate the SW manifest. >>>>>> >>>>>> And this is why I sent the patch in rather than just taking it. This >>>>>> patch was a response to Chirag running in the above error when trying to >>>>>> add the tiny image into the core bundle in the processor sdk. >>>>>> >>>>>> So, why do we want to add tiny to the bundle? >>>>> >>>>> >>>>> We got a requirement from Bin Liu to add tiny-image in >>>>> /board-support/prebuilt-images/ of the SDK bundle. >>>>> I'm not sure about the "why do we want it to the bundle" part. Adding Bin to >>>>> provide more insights on the requirement part. >>>> >>>> The tiny image is very small and uses SysVInit. It has been used in many >>>> use cases, initramfs is the most important one as far as I am aware. >>> >>> >>> All of the images now use systemd. >> >> Correction - all of the images in a single build use the same init manager, >> which by default is systemd. > > systermd or sysvinit is not a concern, as long as there is a "tiny" > image for initramfs use cases. > >> >> There used to be a hack that would force tiny image to use SysVinit, even >> when other images use systemd. It was non-standard and problematic, so was >> removed recently. >> >> There is still a way to control init manager for all Arago images by setting >> ARAGO_SYSVINIT="1" or more directly INIT_MANAGER="sysvinit". But that would >> affect all images, not just tiny. >> >> And if you really want tiny to use SysVinit and other images to use systemd, >> you have to build them separately and you cannot have tiny in tisdk bundle. >> >> FS images in the bundle. >>> The issue comes down to license compliance. The core bundle has the >>> requirement to produce a software license manifest for all of the >>> items within the image. That manifest is generated off of the opkg >>> control files. But the tiny image does not have opkg installed as >>> it is not needed for the purpose of that image. So we cannot gather >>> the manifest information from the tiny image. >>> >>> So we have an impossible situation here. We cannot include the tiny >>> image without violation the manifest requirement. And given that >>> the tiny image is mainly meant for wakeup efforts, I don't see a >>> need to include it in the bundle. If someone wants the tiny image, > > I guess by "wakeup efforts" you meant TI internal consumption? No, > customers often used it for custom board bringup. The importance has no > difference from the "tiny" image to other > > -Bin. The issue is not if customers find the image useful, the issue is license reporting compliance we have for including the prebuilt image as part of the core-bundle. Since we cannot auto generate the license manifest since our code uses the opkg framework to extract that info, we cannot generate the license manifest for the tiny image. A new system for correctly generating the license manifest would have to be devised to support this request. At this time, we cannot include the tiny image in the core-bundle. A must larger effort to revamp the manifest code would have be done to correctly fulfill this corporate requirement. And there is nothing stopping a customer from setting up a yocto build and running: MACHINE=????? bitbake tisdk-tiny-image We just cannot, currently, do it for them and include it in the prebuilt bundle. >>> they can always run bitbake and generate it. It should not take >>> that much time given that it contains almost no packages within it. >>> >>> >>>> -Bin. >>>> >>>>> >>>>> Regards, >>>>> Chirag >>>>> >>>>>> Since tiny should be a subset of the other images, is there anything >>>>>> not covered in the software manifest that should prevent this patch? >>>>>> >>>>>>> >>>>>>>> Signed-off-by: Ryan Eatmon <reatmon@ti.com> >>>>>>>> --- >>>>>>>> meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- >>>>>>>> 1 file changed, 2 insertions(+), 2 deletions(-) >>>>>>>> >>>>>>>> diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>>>>> b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>>>>> index 14d14f08..b9c63610 100644 >>>>>>>> --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>>>>> +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass >>>>>>>> @@ -405,10 +405,10 @@ sw_manifest_target() { >>>>>>>> # Only extract tar.gz or tar.bz2 types >>>>>>>> if [ -e >>>>>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] >>>>>>>> then >>>>>>>> - tar xJf >>>>>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C >>>>>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control >>>>>>>> + tar xJf >>>>>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C >>>>>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No >>>>>>>> control files found in ${image}" >>>>>>>> elif [ -e >>>>>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] >>>>>>>> then >>>>>>>> - tar xzf >>>>>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C >>>>>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control >>>>>>>> + tar xzf >>>>>>>> ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C >>>>>>>> ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No >>>>>>>> control files found in ${image}" >>>>>>>> fi >>>>>>>> done >>>>>>>> -- >>>>>>>> 2.17.1 >>>>>> -- Ryan Eatmon reatmon@ti.com ----------------------------------------- Texas Instruments, Inc. - LCPD - MGTS ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error 2023-11-08 14:12 ` Ryan Eatmon @ 2023-11-08 14:21 ` Bin Liu 0 siblings, 0 replies; 14+ messages in thread From: Bin Liu @ 2023-11-08 14:21 UTC (permalink / raw) To: Ryan Eatmon Cc: Denys Dmytriyenko, Chirag Shilwant, Praneeth Bajjuri, Denys Dmytriyenko, meta-arago Hi Ryan, On Wed, Nov 08, 2023 at 08:12:27AM -0600, Ryan Eatmon wrote: > > > On 11/7/2023 4:19 PM, Bin Liu wrote: > > Hi, > > > > On Fri, Nov 03, 2023 at 05:17:45PM -0400, Denys Dmytriyenko wrote: > > > On Fri, Nov 03, 2023 at 11:18:31AM -0500, Ryan Eatmon via lists.yoctoproject.org wrote: > > > > > > > > > > > > On 11/2/2023 3:37 PM, Bin Liu wrote: > > > > > Hi, > > > > > > > > > > On Thu, Nov 02, 2023 at 05:18:21PM +0530, Chirag Shilwant wrote: > > > > > > Hi Ryan, > > > > > > > > > > > > On 31/10/23 21:29, Ryan Eatmon via lists.yoctoproject.org wrote: > > > > > > > > > > > > > > > > > > > > > On 10/31/2023 10:44 AM, Denys Dmytriyenko wrote: > > > > > > > > On Tue, Oct 31, 2023 at 09:04:32AM -0500, Ryan Eatmon via > > > > > > > > lists.yoctoproject.org wrote: > > > > > > > > > We want to add an image into the core bundle, but that image does not > > > > > > > > > have any opkg .control files. tar apparently errors out if you ask it > > > > > > > > > to extract out files but the files are not in the archive, and the > > > > > > > > > recipes are setup that if any of the commands in the shell error out, > > > > > > > > > then the entire recipe fails. > > > > > > > > > > > > > > > > > > Simple fix, add an || (or) condition to the tar command to print a > > > > > > > > > message that there were not any control files instead of erroring out. > > > > > > > > > > > > > > > > So, simply bypassing tar error due to missing *.control files still > > > > > > > > won't > > > > > > > > enable you to properly generate the SW manifest. As those *.control > > > > > > > > files > > > > > > > >from individual packages are parsed to extract the license information. > > > > > > > > And they are missing because tiny image specifically disables "package > > > > > > > > management" to save on space. Therefore tiny image was not included in > > > > > > > > the bundle, since it doesn't generate the SW manifest. > > > > > > > > > > > > > > And this is why I sent the patch in rather than just taking it. This > > > > > > > patch was a response to Chirag running in the above error when trying to > > > > > > > add the tiny image into the core bundle in the processor sdk. > > > > > > > > > > > > > > So, why do we want to add tiny to the bundle? > > > > > > > > > > > > > > > > > > We got a requirement from Bin Liu to add tiny-image in > > > > > > /board-support/prebuilt-images/ of the SDK bundle. > > > > > > I'm not sure about the "why do we want it to the bundle" part. Adding Bin to > > > > > > provide more insights on the requirement part. > > > > > > > > > > The tiny image is very small and uses SysVInit. It has been used in many > > > > > use cases, initramfs is the most important one as far as I am aware. > > > > > > > > > > > > All of the images now use systemd. > > > > > > Correction - all of the images in a single build use the same init manager, > > > which by default is systemd. > > > > systermd or sysvinit is not a concern, as long as there is a "tiny" > > image for initramfs use cases. > > > > > > > > There used to be a hack that would force tiny image to use SysVinit, even > > > when other images use systemd. It was non-standard and problematic, so was > > > removed recently. > > > > > > There is still a way to control init manager for all Arago images by setting > > > ARAGO_SYSVINIT="1" or more directly INIT_MANAGER="sysvinit". But that would > > > affect all images, not just tiny. > > > > > > And if you really want tiny to use SysVinit and other images to use systemd, > > > you have to build them separately and you cannot have tiny in tisdk bundle. > > > > > > FS images in the bundle. > > > > The issue comes down to license compliance. The core bundle has the > > > > requirement to produce a software license manifest for all of the > > > > items within the image. That manifest is generated off of the opkg > > > > control files. But the tiny image does not have opkg installed as > > > > it is not needed for the purpose of that image. So we cannot gather > > > > the manifest information from the tiny image. > > > > > > > > So we have an impossible situation here. We cannot include the tiny > > > > image without violation the manifest requirement. And given that > > > > the tiny image is mainly meant for wakeup efforts, I don't see a > > > > need to include it in the bundle. If someone wants the tiny image, > > > > I guess by "wakeup efforts" you meant TI internal consumption? No, > > customers often used it for custom board bringup. The importance has no > > difference from the "tiny" image to other > > > > -Bin. > > The issue is not if customers find the image useful, the issue is license > reporting compliance we have for including the prebuilt image as part of the > core-bundle. Since we cannot auto generate the license manifest since our > code uses the opkg framework to extract that info, we cannot generate the > license manifest for the tiny image. Understood the challenge. My response was purely for the specific comments about systemd vs sysvinit, or wakeup efforts, etc... -Bin. > > A new system for correctly generating the license manifest would have to be > devised to support this request. At this time, we cannot include the tiny > image in the core-bundle. A must larger effort to revamp the manifest code > would have be done to correctly fulfill this corporate requirement. > > And there is nothing stopping a customer from setting up a yocto build and > running: > > MACHINE=????? bitbake tisdk-tiny-image > > We just cannot, currently, do it for them and include it in the prebuilt > bundle. > > > > > > > they can always run bitbake and generate it. It should not take > > > > that much time given that it contains almost no packages within it. > > > > > > > > > > > > > -Bin. > > > > > > > > > > > > > > > > > Regards, > > > > > > Chirag > > > > > > > > > > > > > Since tiny should be a subset of the other images, is there anything > > > > > > > not covered in the software manifest that should prevent this patch? > > > > > > > > > > > > > > > > > > > > > > > > Signed-off-by: Ryan Eatmon <reatmon@ti.com> > > > > > > > > > --- > > > > > > > > > meta-arago-distro/classes/tisdk-sw-manifest.bbclass | 4 ++-- > > > > > > > > > 1 file changed, 2 insertions(+), 2 deletions(-) > > > > > > > > > > > > > > > > > > diff --git a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > > > > > b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > > > > > index 14d14f08..b9c63610 100644 > > > > > > > > > --- a/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > > > > > +++ b/meta-arago-distro/classes/tisdk-sw-manifest.bbclass > > > > > > > > > @@ -405,10 +405,10 @@ sw_manifest_target() { > > > > > > > > > # Only extract tar.gz or tar.bz2 types > > > > > > > > > if [ -e > > > > > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz ] > > > > > > > > > then > > > > > > > > > - tar xJf > > > > > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > > > > > > + tar xJf > > > > > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.xz -C > > > > > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > > > > > > control files found in ${image}" > > > > > > > > > elif [ -e > > > > > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz ] > > > > > > > > > then > > > > > > > > > - tar xzf > > > > > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control > > > > > > > > > + tar xzf > > > > > > > > > ${IMAGE_ROOTFS}/filesystem/${image}-${MACHINE}.tar.gz -C > > > > > > > > > ${IMAGE_ROOTFS}/filesystem --wildcards *.control || echo "No > > > > > > > > > control files found in ${image}" > > > > > > > > > fi > > > > > > > > > done > > > > > > > > > -- > > > > > > > > > 2.17.1 > > > > > > > > > -- > Ryan Eatmon reatmon@ti.com > ----------------------------------------- > Texas Instruments, Inc. - LCPD - MGTS ^ permalink raw reply [flat|nested] 14+ messages in thread
end of thread, other threads:[~2023-11-08 14:21 UTC | newest] Thread overview: 14+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2023-10-31 14:04 [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error Ryan Eatmon 2023-10-31 14:04 ` [meta-arago][master/kirkstone][PATCH 2/2] tisdk-core-bundle: Add the tiny image into the core bundle Ryan Eatmon 2023-10-31 15:44 ` [meta-arago][master/kirkstone][PATCH 1/2] tisdk-sw-manifest: Add code to not fail on tar error Denys Dmytriyenko 2023-10-31 15:59 ` Ryan Eatmon 2023-10-31 19:03 ` Denys Dmytriyenko 2023-11-02 11:48 ` [EXTERNAL] " Chirag Shilwant 2023-11-02 20:37 ` Bin Liu 2023-11-03 13:54 ` Bin Liu 2023-11-03 14:25 ` [EXTERNAL] " Bin Liu 2023-11-03 16:18 ` Ryan Eatmon 2023-11-03 21:17 ` Denys Dmytriyenko 2023-11-07 22:19 ` Bin Liu 2023-11-08 14:12 ` Ryan Eatmon 2023-11-08 14:21 ` Bin Liu
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.