All of lore.kernel.org
 help / color / mirror / Atom feed
* [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
@ 2015-03-06 14:34 Jacob Stiffler
  2015-03-06 19:26 ` Stiffler, Jacob
  0 siblings, 1 reply; 8+ messages in thread
From: Jacob Stiffler @ 2015-03-06 14:34 UTC (permalink / raw)
  To: meta-arago

* The manifest is automatically generated based on *.control
  files found within the various images.
* The control files for the nativesdk image have gone missing.
* Work around this by regenerating the control files from the
  package index.

Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
---
v2 changes:
Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.


 meta-arago-distro/classes/tisdk-image.bbclass |   37 +++++++++++++++++++++++++
 1 file changed, 37 insertions(+)

diff --git a/meta-arago-distro/classes/tisdk-image.bbclass b/meta-arago-distro/classes/tisdk-image.bbclass
index 3030a38..b9d86af 100644
--- a/meta-arago-distro/classes/tisdk-image.bbclass
+++ b/meta-arago-distro/classes/tisdk-image.bbclass
@@ -353,6 +353,43 @@ echo "
 </tr>
 " >> ${SW_MANIFEST_FILE}
 
+    control_files_there=0
+    for possible_control_file in $control_dir/*.control
+    do
+        if [ -f $possible_control_file ]
+        then
+            control_files_there=1
+            break
+        fi
+    done
+
+    if [ $control_files_there -eq 0 ]
+    then
+        for pkg_idx in $control_dir/oe*; do
+            package_start=`grep -n "^Package" $pkg_idx`
+
+            IFS_OLD=${IFS}
+            IFS="
+"
+
+            for pkg in ${package_start}; do
+                end=`echo $pkg | cut -d: -f1`
+
+                if [ -z $begin ]; then
+                    pkg_name=`echo $pkg | cut -d: -f3`
+                    begin=`echo $pkg | cut -d: -f1`
+                    continue
+                fi
+                cnt=$[$cnt+1]
+                head -n $[$end - 1] $pkg_idx | tail -n $[$end - $begin] > ${control_dir}/${pkg_name// /}.control
+
+                pkg_name=`echo $pkg | cut -d: -f3`
+                begin=$end
+            done
+            IFS=${IFS_OLD}
+        done
+    fi
+
     for i in $control_dir/*.control
     do
         package="`cat $i | grep Package: | awk {'print $2'}`"
-- 
1.7.9.5



^ permalink raw reply related	[flat|nested] 8+ messages in thread

* Re: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
  2015-03-06 14:34 [PATCH v2] tisdk-image: Fix manifest generation for nativesdk Jacob Stiffler
@ 2015-03-06 19:26 ` Stiffler, Jacob
  2015-03-06 19:38   ` Cooper Jr., Franklin
  0 siblings, 1 reply; 8+ messages in thread
From: Stiffler, Jacob @ 2015-03-06 19:26 UTC (permalink / raw)
  To: meta-arago@arago-project.org

I also need to revoke this patch. I forgot I am not able to recreate this issue on my local setup, and I have only seen it on the build machine. 

This patch will cause a build failure if any of the oe* package indexes are empty, as the " grep -n "^Package" $pkg_idx" will return an error.

Are there any other comments which I may address in the v3?

Thanks,
Jake

-----Original Message-----
From: Stiffler, Jacob 
Sent: Friday, March 06, 2015 9:34 AM
To: meta-arago@arago-project.org
Cc: Stiffler, Jacob
Subject: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.

* The manifest is automatically generated based on *.control
  files found within the various images.
* The control files for the nativesdk image have gone missing.
* Work around this by regenerating the control files from the
  package index.

Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
---
v2 changes:
Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.


 meta-arago-distro/classes/tisdk-image.bbclass |   37 +++++++++++++++++++++++++
 1 file changed, 37 insertions(+)

diff --git a/meta-arago-distro/classes/tisdk-image.bbclass b/meta-arago-distro/classes/tisdk-image.bbclass
index 3030a38..b9d86af 100644
--- a/meta-arago-distro/classes/tisdk-image.bbclass
+++ b/meta-arago-distro/classes/tisdk-image.bbclass
@@ -353,6 +353,43 @@ echo "
 </tr>
 " >> ${SW_MANIFEST_FILE}
 
+    control_files_there=0
+    for possible_control_file in $control_dir/*.control
+    do
+        if [ -f $possible_control_file ]
+        then
+            control_files_there=1
+            break
+        fi
+    done
+
+    if [ $control_files_there -eq 0 ]
+    then
+        for pkg_idx in $control_dir/oe*; do
+            package_start=`grep -n "^Package" $pkg_idx`
+
+            IFS_OLD=${IFS}
+            IFS="
+"
+
+            for pkg in ${package_start}; do
+                end=`echo $pkg | cut -d: -f1`
+
+                if [ -z $begin ]; then
+                    pkg_name=`echo $pkg | cut -d: -f3`
+                    begin=`echo $pkg | cut -d: -f1`
+                    continue
+                fi
+                cnt=$[$cnt+1]
+                head -n $[$end - 1] $pkg_idx | tail -n $[$end - $begin] > ${control_dir}/${pkg_name// /}.control
+
+                pkg_name=`echo $pkg | cut -d: -f3`
+                begin=$end
+            done
+            IFS=${IFS_OLD}
+        done
+    fi
+
     for i in $control_dir/*.control
     do
         package="`cat $i | grep Package: | awk {'print $2'}`"
-- 
1.7.9.5



^ permalink raw reply related	[flat|nested] 8+ messages in thread

* Re: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
  2015-03-06 19:26 ` Stiffler, Jacob
@ 2015-03-06 19:38   ` Cooper Jr., Franklin
  2015-03-06 19:45     ` Stiffler, Jacob
  0 siblings, 1 reply; 8+ messages in thread
From: Cooper Jr., Franklin @ 2015-03-06 19:38 UTC (permalink / raw)
  To: Stiffler, Jacob, meta-arago@arago-project.org

Don't know what the issue is especially since your saying that the problem is on the build machine and not your local setup.

I just made a release a little less than a month ago and haven't had a problem on my local or build machine. Nothing important has changed within oe-core in the last several months and nothing has changed within oe-core within the last several months. Denys did change the version of bitbake used by default but that wouldn't explain the different behavior between your machines.

So it seems like the issue points to your build machine.

> -----Original Message-----
> From: meta-arago-bounces@arago-project.org [mailto:meta-arago-
> bounces@arago-project.org] On Behalf Of Stiffler, Jacob
> Sent: Friday, March 06, 2015 1:26 PM
> To: meta-arago@arago-project.org
> Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation
> for nativesdk.
> 
> I also need to revoke this patch. I forgot I am not able to recreate this issue
> on my local setup, and I have only seen it on the build machine.
> 
> This patch will cause a build failure if any of the oe* package indexes are
> empty, as the " grep -n "^Package" $pkg_idx" will return an error.
> 
> Are there any other comments which I may address in the v3?
> 
> Thanks,
> Jake
> 
> -----Original Message-----
> From: Stiffler, Jacob
> Sent: Friday, March 06, 2015 9:34 AM
> To: meta-arago@arago-project.org
> Cc: Stiffler, Jacob
> Subject: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
> 
> * The manifest is automatically generated based on *.control
>   files found within the various images.
> * The control files for the nativesdk image have gone missing.
> * Work around this by regenerating the control files from the
>   package index.
> 
> Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
> ---
> v2 changes:
> Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.
> 
> 
>  meta-arago-distro/classes/tisdk-image.bbclass |   37
> +++++++++++++++++++++++++
>  1 file changed, 37 insertions(+)
> 
> diff --git a/meta-arago-distro/classes/tisdk-image.bbclass b/meta-arago-
> distro/classes/tisdk-image.bbclass
> index 3030a38..b9d86af 100644
> --- a/meta-arago-distro/classes/tisdk-image.bbclass
> +++ b/meta-arago-distro/classes/tisdk-image.bbclass
> @@ -353,6 +353,43 @@ echo "
>  </tr>
>  " >> ${SW_MANIFEST_FILE}
> 
> +    control_files_there=0
> +    for possible_control_file in $control_dir/*.control
> +    do
> +        if [ -f $possible_control_file ]
> +        then
> +            control_files_there=1
> +            break
> +        fi
> +    done
> +
> +    if [ $control_files_there -eq 0 ]
> +    then
> +        for pkg_idx in $control_dir/oe*; do
> +            package_start=`grep -n "^Package" $pkg_idx`
> +
> +            IFS_OLD=${IFS}
> +            IFS="
> +"
> +
> +            for pkg in ${package_start}; do
> +                end=`echo $pkg | cut -d: -f1`
> +
> +                if [ -z $begin ]; then
> +                    pkg_name=`echo $pkg | cut -d: -f3`
> +                    begin=`echo $pkg | cut -d: -f1`
> +                    continue
> +                fi
> +                cnt=$[$cnt+1]
> +                head -n $[$end - 1] $pkg_idx | tail -n $[$end - $begin] >
> ${control_dir}/${pkg_name// /}.control
> +
> +                pkg_name=`echo $pkg | cut -d: -f3`
> +                begin=$end
> +            done
> +            IFS=${IFS_OLD}
> +        done
> +    fi
> +
>      for i in $control_dir/*.control
>      do
>          package="`cat $i | grep Package: | awk {'print $2'}`"
> --
> 1.7.9.5
> 
> _______________________________________________
> meta-arago mailing list
> meta-arago@arago-project.org
> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
  2015-03-06 19:38   ` Cooper Jr., Franklin
@ 2015-03-06 19:45     ` Stiffler, Jacob
  2015-03-06 20:49       ` Cooper Jr., Franklin
  0 siblings, 1 reply; 8+ messages in thread
From: Stiffler, Jacob @ 2015-03-06 19:45 UTC (permalink / raw)
  To: Cooper Jr., Franklin, meta-arago@arago-project.org

I ran into this issue in December. Denys also reported seeing the same issue.

-----Original Message-----
From: Cooper Jr., Franklin 
Sent: Friday, March 06, 2015 2:38 PM
To: Stiffler, Jacob; meta-arago@arago-project.org
Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.

Don't know what the issue is especially since your saying that the problem is on the build machine and not your local setup.

I just made a release a little less than a month ago and haven't had a problem on my local or build machine. Nothing important has changed within oe-core in the last several months and nothing has changed within oe-core within the last several months. Denys did change the version of bitbake used by default but that wouldn't explain the different behavior between your machines.

So it seems like the issue points to your build machine.

> -----Original Message-----
> From: meta-arago-bounces@arago-project.org [mailto:meta-arago- 
> bounces@arago-project.org] On Behalf Of Stiffler, Jacob
> Sent: Friday, March 06, 2015 1:26 PM
> To: meta-arago@arago-project.org
> Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest 
> generation for nativesdk.
> 
> I also need to revoke this patch. I forgot I am not able to recreate 
> this issue on my local setup, and I have only seen it on the build machine.
> 
> This patch will cause a build failure if any of the oe* package 
> indexes are empty, as the " grep -n "^Package" $pkg_idx" will return an error.
> 
> Are there any other comments which I may address in the v3?
> 
> Thanks,
> Jake
> 
> -----Original Message-----
> From: Stiffler, Jacob
> Sent: Friday, March 06, 2015 9:34 AM
> To: meta-arago@arago-project.org
> Cc: Stiffler, Jacob
> Subject: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
> 
> * The manifest is automatically generated based on *.control
>   files found within the various images.
> * The control files for the nativesdk image have gone missing.
> * Work around this by regenerating the control files from the
>   package index.
> 
> Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
> ---
> v2 changes:
> Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.
> 
> 
>  meta-arago-distro/classes/tisdk-image.bbclass |   37
> +++++++++++++++++++++++++
>  1 file changed, 37 insertions(+)
> 
> diff --git a/meta-arago-distro/classes/tisdk-image.bbclass 
> b/meta-arago- distro/classes/tisdk-image.bbclass
> index 3030a38..b9d86af 100644
> --- a/meta-arago-distro/classes/tisdk-image.bbclass
> +++ b/meta-arago-distro/classes/tisdk-image.bbclass
> @@ -353,6 +353,43 @@ echo "
>  </tr>
>  " >> ${SW_MANIFEST_FILE}
> 
> +    control_files_there=0
> +    for possible_control_file in $control_dir/*.control
> +    do
> +        if [ -f $possible_control_file ]
> +        then
> +            control_files_there=1
> +            break
> +        fi
> +    done
> +
> +    if [ $control_files_there -eq 0 ]
> +    then
> +        for pkg_idx in $control_dir/oe*; do
> +            package_start=`grep -n "^Package" $pkg_idx`
> +
> +            IFS_OLD=${IFS}
> +            IFS="
> +"
> +
> +            for pkg in ${package_start}; do
> +                end=`echo $pkg | cut -d: -f1`
> +
> +                if [ -z $begin ]; then
> +                    pkg_name=`echo $pkg | cut -d: -f3`
> +                    begin=`echo $pkg | cut -d: -f1`
> +                    continue
> +                fi
> +                cnt=$[$cnt+1]
> +                head -n $[$end - 1] $pkg_idx | tail -n $[$end - 
> + $begin] >
> ${control_dir}/${pkg_name// /}.control
> +
> +                pkg_name=`echo $pkg | cut -d: -f3`
> +                begin=$end
> +            done
> +            IFS=${IFS_OLD}
> +        done
> +    fi
> +
>      for i in $control_dir/*.control
>      do
>          package="`cat $i | grep Package: | awk {'print $2'}`"
> --
> 1.7.9.5
> 
> _______________________________________________
> meta-arago mailing list
> meta-arago@arago-project.org
> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
  2015-03-06 19:45     ` Stiffler, Jacob
@ 2015-03-06 20:49       ` Cooper Jr., Franklin
  2015-03-06 22:48         ` Denys Dmytriyenko
  0 siblings, 1 reply; 8+ messages in thread
From: Cooper Jr., Franklin @ 2015-03-06 20:49 UTC (permalink / raw)
  To: Stiffler, Jacob, meta-arago@arago-project.org

Ah I'm not aware of that since I never ran into the issue.

> -----Original Message-----
> From: Stiffler, Jacob
> Sent: Friday, March 06, 2015 1:45 PM
> To: Cooper Jr., Franklin; meta-arago@arago-project.org
> Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation
> for nativesdk.
> 
> I ran into this issue in December. Denys also reported seeing the same issue.
> 
> -----Original Message-----
> From: Cooper Jr., Franklin
> Sent: Friday, March 06, 2015 2:38 PM
> To: Stiffler, Jacob; meta-arago@arago-project.org
> Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation
> for nativesdk.
> 
> Don't know what the issue is especially since your saying that the problem is
> on the build machine and not your local setup.
> 
> I just made a release a little less than a month ago and haven't had a problem
> on my local or build machine. Nothing important has changed within oe-core
> in the last several months and nothing has changed within oe-core within the
> last several months. Denys did change the version of bitbake used by default
> but that wouldn't explain the different behavior between your machines.
> 
> So it seems like the issue points to your build machine.
> 
> > -----Original Message-----
> > From: meta-arago-bounces@arago-project.org [mailto:meta-arago-
> > bounces@arago-project.org] On Behalf Of Stiffler, Jacob
> > Sent: Friday, March 06, 2015 1:26 PM
> > To: meta-arago@arago-project.org
> > Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest
> > generation for nativesdk.
> >
> > I also need to revoke this patch. I forgot I am not able to recreate
> > this issue on my local setup, and I have only seen it on the build machine.
> >
> > This patch will cause a build failure if any of the oe* package
> > indexes are empty, as the " grep -n "^Package" $pkg_idx" will return an
> error.
> >
> > Are there any other comments which I may address in the v3?
> >
> > Thanks,
> > Jake
> >
> > -----Original Message-----
> > From: Stiffler, Jacob
> > Sent: Friday, March 06, 2015 9:34 AM
> > To: meta-arago@arago-project.org
> > Cc: Stiffler, Jacob
> > Subject: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
> >
> > * The manifest is automatically generated based on *.control
> >   files found within the various images.
> > * The control files for the nativesdk image have gone missing.
> > * Work around this by regenerating the control files from the
> >   package index.
> >
> > Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
> > ---
> > v2 changes:
> > Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.
> >
> >
> >  meta-arago-distro/classes/tisdk-image.bbclass |   37
> > +++++++++++++++++++++++++
> >  1 file changed, 37 insertions(+)
> >
> > diff --git a/meta-arago-distro/classes/tisdk-image.bbclass
> > b/meta-arago- distro/classes/tisdk-image.bbclass
> > index 3030a38..b9d86af 100644
> > --- a/meta-arago-distro/classes/tisdk-image.bbclass
> > +++ b/meta-arago-distro/classes/tisdk-image.bbclass
> > @@ -353,6 +353,43 @@ echo "
> >  </tr>
> >  " >> ${SW_MANIFEST_FILE}
> >
> > +    control_files_there=0
> > +    for possible_control_file in $control_dir/*.control
> > +    do
> > +        if [ -f $possible_control_file ]
> > +        then
> > +            control_files_there=1
> > +            break
> > +        fi
> > +    done
> > +
> > +    if [ $control_files_there -eq 0 ]
> > +    then
> > +        for pkg_idx in $control_dir/oe*; do
> > +            package_start=`grep -n "^Package" $pkg_idx`
> > +
> > +            IFS_OLD=${IFS}
> > +            IFS="
> > +"
> > +
> > +            for pkg in ${package_start}; do
> > +                end=`echo $pkg | cut -d: -f1`
> > +
> > +                if [ -z $begin ]; then
> > +                    pkg_name=`echo $pkg | cut -d: -f3`
> > +                    begin=`echo $pkg | cut -d: -f1`
> > +                    continue
> > +                fi
> > +                cnt=$[$cnt+1]
> > +                head -n $[$end - 1] $pkg_idx | tail -n $[$end -
> > + $begin] >
> > ${control_dir}/${pkg_name// /}.control
> > +
> > +                pkg_name=`echo $pkg | cut -d: -f3`
> > +                begin=$end
> > +            done
> > +            IFS=${IFS_OLD}
> > +        done
> > +    fi
> > +
> >      for i in $control_dir/*.control
> >      do
> >          package="`cat $i | grep Package: | awk {'print $2'}`"
> > --
> > 1.7.9.5
> >
> > _______________________________________________
> > meta-arago mailing list
> > meta-arago@arago-project.org
> > http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
  2015-03-06 20:49       ` Cooper Jr., Franklin
@ 2015-03-06 22:48         ` Denys Dmytriyenko
  2015-03-09 13:49           ` Stiffler, Jacob
  0 siblings, 1 reply; 8+ messages in thread
From: Denys Dmytriyenko @ 2015-03-06 22:48 UTC (permalink / raw)
  To: Cooper Jr., Franklin; +Cc: meta-arago@arago-project.org

Jake,

Can you please refresh my mind with more details of the problem? Thanks.


On Fri, Mar 06, 2015 at 08:49:10PM +0000, Cooper Jr., Franklin wrote:
> Ah I'm not aware of that since I never ran into the issue.
> 
> > -----Original Message-----
> > From: Stiffler, Jacob
> > Sent: Friday, March 06, 2015 1:45 PM
> > To: Cooper Jr., Franklin; meta-arago@arago-project.org
> > Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation
> > for nativesdk.
> > 
> > I ran into this issue in December. Denys also reported seeing the same issue.
> > 
> > -----Original Message-----
> > From: Cooper Jr., Franklin
> > Sent: Friday, March 06, 2015 2:38 PM
> > To: Stiffler, Jacob; meta-arago@arago-project.org
> > Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation
> > for nativesdk.
> > 
> > Don't know what the issue is especially since your saying that the problem is
> > on the build machine and not your local setup.
> > 
> > I just made a release a little less than a month ago and haven't had a problem
> > on my local or build machine. Nothing important has changed within oe-core
> > in the last several months and nothing has changed within oe-core within the
> > last several months. Denys did change the version of bitbake used by default
> > but that wouldn't explain the different behavior between your machines.
> > 
> > So it seems like the issue points to your build machine.
> > 
> > > -----Original Message-----
> > > From: meta-arago-bounces@arago-project.org [mailto:meta-arago-
> > > bounces@arago-project.org] On Behalf Of Stiffler, Jacob
> > > Sent: Friday, March 06, 2015 1:26 PM
> > > To: meta-arago@arago-project.org
> > > Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest
> > > generation for nativesdk.
> > >
> > > I also need to revoke this patch. I forgot I am not able to recreate
> > > this issue on my local setup, and I have only seen it on the build machine.
> > >
> > > This patch will cause a build failure if any of the oe* package
> > > indexes are empty, as the " grep -n "^Package" $pkg_idx" will return an
> > error.
> > >
> > > Are there any other comments which I may address in the v3?
> > >
> > > Thanks,
> > > Jake
> > >
> > > -----Original Message-----
> > > From: Stiffler, Jacob
> > > Sent: Friday, March 06, 2015 9:34 AM
> > > To: meta-arago@arago-project.org
> > > Cc: Stiffler, Jacob
> > > Subject: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
> > >
> > > * The manifest is automatically generated based on *.control
> > >   files found within the various images.
> > > * The control files for the nativesdk image have gone missing.
> > > * Work around this by regenerating the control files from the
> > >   package index.
> > >
> > > Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
> > > ---
> > > v2 changes:
> > > Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.
> > >
> > >
> > >  meta-arago-distro/classes/tisdk-image.bbclass |   37
> > > +++++++++++++++++++++++++
> > >  1 file changed, 37 insertions(+)
> > >
> > > diff --git a/meta-arago-distro/classes/tisdk-image.bbclass
> > > b/meta-arago- distro/classes/tisdk-image.bbclass
> > > index 3030a38..b9d86af 100644
> > > --- a/meta-arago-distro/classes/tisdk-image.bbclass
> > > +++ b/meta-arago-distro/classes/tisdk-image.bbclass
> > > @@ -353,6 +353,43 @@ echo "
> > >  </tr>
> > >  " >> ${SW_MANIFEST_FILE}
> > >
> > > +    control_files_there=0
> > > +    for possible_control_file in $control_dir/*.control
> > > +    do
> > > +        if [ -f $possible_control_file ]
> > > +        then
> > > +            control_files_there=1
> > > +            break
> > > +        fi
> > > +    done
> > > +
> > > +    if [ $control_files_there -eq 0 ]
> > > +    then
> > > +        for pkg_idx in $control_dir/oe*; do
> > > +            package_start=`grep -n "^Package" $pkg_idx`
> > > +
> > > +            IFS_OLD=${IFS}
> > > +            IFS="
> > > +"
> > > +
> > > +            for pkg in ${package_start}; do
> > > +                end=`echo $pkg | cut -d: -f1`
> > > +
> > > +                if [ -z $begin ]; then
> > > +                    pkg_name=`echo $pkg | cut -d: -f3`
> > > +                    begin=`echo $pkg | cut -d: -f1`
> > > +                    continue
> > > +                fi
> > > +                cnt=$[$cnt+1]
> > > +                head -n $[$end - 1] $pkg_idx | tail -n $[$end -
> > > + $begin] >
> > > ${control_dir}/${pkg_name// /}.control
> > > +
> > > +                pkg_name=`echo $pkg | cut -d: -f3`
> > > +                begin=$end
> > > +            done
> > > +            IFS=${IFS_OLD}
> > > +        done
> > > +    fi
> > > +
> > >      for i in $control_dir/*.control
> > >      do
> > >          package="`cat $i | grep Package: | awk {'print $2'}`"
> > > --
> > > 1.7.9.5
> > >
> > > _______________________________________________
> > > meta-arago mailing list
> > > meta-arago@arago-project.org
> > > http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago
> _______________________________________________
> meta-arago mailing list
> meta-arago@arago-project.org
> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
  2015-03-06 22:48         ` Denys Dmytriyenko
@ 2015-03-09 13:49           ` Stiffler, Jacob
  0 siblings, 0 replies; 8+ messages in thread
From: Stiffler, Jacob @ 2015-03-09 13:49 UTC (permalink / raw)
  To: Dmytriyenko, Denys, Cooper Jr., Franklin; +Cc: meta-arago@arago-project.org

The software manifest is created by parsing the *.control files in the images /var/lib/opkg directory. For the nativesdk sysroot, there are some cases where the control files are not present. The reason for this and the specific circumstances of when this occurs has not yet been root caused. 

When this does happen, the "Development Host Content" tables of the manifest are not valid. However, the package indexes are present. These contain all of the information in the control files, only concatenated together in a large file. This patch will split up these package indexes into individual control files which will allow the previous parsing to produce a valid output.


Here is an example of the invalid output when the control files are not present:

<h2><u>Development Host Content</u></h2>
<p>This table describes any software being delivered that is expected to run on a Development Host, instead of the target device.  Some of this software may be licensed under GPLv3 but it is not expected to be shipped as a product.</p>

<table border=1 cellspacing=1 cellpadding=1 width=80%>
<tr bgcolor=#c0c0c0  color=white>
    <td><b>Software Name</b></td>
    <td><b>Version</b></td>
    <td><b>License</b></td>
    <td><b>Location</b></td>
    <td><b>Delivered As</b></td>
    <td><b>Modified by TI</b></td>
    <td><b>Obtained from</b></td>
</tr>

<tr>
    <td> </td>
    <td></td>
    <td ></td>
    <td>__.ipk</td>
    <td>Binary</td>
    <td>No</td>
    <td></td>
</tr>


- Jake



-----Original Message-----
From: Dmytriyenko, Denys 
Sent: Friday, March 06, 2015 5:48 PM
To: Cooper Jr., Franklin
Cc: Stiffler, Jacob; meta-arago@arago-project.org
Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.

Jake,

Can you please refresh my mind with more details of the problem? Thanks.


On Fri, Mar 06, 2015 at 08:49:10PM +0000, Cooper Jr., Franklin wrote:
> Ah I'm not aware of that since I never ran into the issue.
> 
> > -----Original Message-----
> > From: Stiffler, Jacob
> > Sent: Friday, March 06, 2015 1:45 PM
> > To: Cooper Jr., Franklin; meta-arago@arago-project.org
> > Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest 
> > generation for nativesdk.
> > 
> > I ran into this issue in December. Denys also reported seeing the same issue.
> > 
> > -----Original Message-----
> > From: Cooper Jr., Franklin
> > Sent: Friday, March 06, 2015 2:38 PM
> > To: Stiffler, Jacob; meta-arago@arago-project.org
> > Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest 
> > generation for nativesdk.
> > 
> > Don't know what the issue is especially since your saying that the 
> > problem is on the build machine and not your local setup.
> > 
> > I just made a release a little less than a month ago and haven't had 
> > a problem on my local or build machine. Nothing important has 
> > changed within oe-core in the last several months and nothing has 
> > changed within oe-core within the last several months. Denys did 
> > change the version of bitbake used by default but that wouldn't explain the different behavior between your machines.
> > 
> > So it seems like the issue points to your build machine.
> > 
> > > -----Original Message-----
> > > From: meta-arago-bounces@arago-project.org [mailto:meta-arago- 
> > > bounces@arago-project.org] On Behalf Of Stiffler, Jacob
> > > Sent: Friday, March 06, 2015 1:26 PM
> > > To: meta-arago@arago-project.org
> > > Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest 
> > > generation for nativesdk.
> > >
> > > I also need to revoke this patch. I forgot I am not able to 
> > > recreate this issue on my local setup, and I have only seen it on the build machine.
> > >
> > > This patch will cause a build failure if any of the oe* package 
> > > indexes are empty, as the " grep -n "^Package" $pkg_idx" will 
> > > return an
> > error.
> > >
> > > Are there any other comments which I may address in the v3?
> > >
> > > Thanks,
> > > Jake
> > >
> > > -----Original Message-----
> > > From: Stiffler, Jacob
> > > Sent: Friday, March 06, 2015 9:34 AM
> > > To: meta-arago@arago-project.org
> > > Cc: Stiffler, Jacob
> > > Subject: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
> > >
> > > * The manifest is automatically generated based on *.control
> > >   files found within the various images.
> > > * The control files for the nativesdk image have gone missing.
> > > * Work around this by regenerating the control files from the
> > >   package index.
> > >
> > > Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
> > > ---
> > > v2 changes:
> > > Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.
> > >
> > >
> > >  meta-arago-distro/classes/tisdk-image.bbclass |   37
> > > +++++++++++++++++++++++++
> > >  1 file changed, 37 insertions(+)
> > >
> > > diff --git a/meta-arago-distro/classes/tisdk-image.bbclass
> > > b/meta-arago- distro/classes/tisdk-image.bbclass
> > > index 3030a38..b9d86af 100644
> > > --- a/meta-arago-distro/classes/tisdk-image.bbclass
> > > +++ b/meta-arago-distro/classes/tisdk-image.bbclass
> > > @@ -353,6 +353,43 @@ echo "
> > >  </tr>
> > >  " >> ${SW_MANIFEST_FILE}
> > >
> > > +    control_files_there=0
> > > +    for possible_control_file in $control_dir/*.control
> > > +    do
> > > +        if [ -f $possible_control_file ]
> > > +        then
> > > +            control_files_there=1
> > > +            break
> > > +        fi
> > > +    done
> > > +
> > > +    if [ $control_files_there -eq 0 ]
> > > +    then
> > > +        for pkg_idx in $control_dir/oe*; do
> > > +            package_start=`grep -n "^Package" $pkg_idx`
> > > +
> > > +            IFS_OLD=${IFS}
> > > +            IFS="
> > > +"
> > > +
> > > +            for pkg in ${package_start}; do
> > > +                end=`echo $pkg | cut -d: -f1`
> > > +
> > > +                if [ -z $begin ]; then
> > > +                    pkg_name=`echo $pkg | cut -d: -f3`
> > > +                    begin=`echo $pkg | cut -d: -f1`
> > > +                    continue
> > > +                fi
> > > +                cnt=$[$cnt+1]
> > > +                head -n $[$end - 1] $pkg_idx | tail -n $[$end - 
> > > + $begin] >
> > > ${control_dir}/${pkg_name// /}.control
> > > +
> > > +                pkg_name=`echo $pkg | cut -d: -f3`
> > > +                begin=$end
> > > +            done
> > > +            IFS=${IFS_OLD}
> > > +        done
> > > +    fi
> > > +
> > >      for i in $control_dir/*.control
> > >      do
> > >          package="`cat $i | grep Package: | awk {'print $2'}`"
> > > --
> > > 1.7.9.5
> > >
> > > _______________________________________________
> > > meta-arago mailing list
> > > meta-arago@arago-project.org
> > > http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago
> _______________________________________________
> meta-arago mailing list
> meta-arago@arago-project.org
> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
@ 2015-03-09 16:03 Dmytriyenko, Denys
  0 siblings, 0 replies; 8+ messages in thread
From: Dmytriyenko, Denys @ 2015-03-09 16:03 UTC (permalink / raw)
  To: Stiffler, Jacob; +Cc: meta-arago@arago-project.org, Cooper Jr., Franklin

[-- Attachment #1: Type: text/plain, Size: 7287 bytes --]

Thanks! I would like this writeup to be captured in the commit log for future reference.

--
Denys

On Mar 9, 2015 9:49 AM, "Stiffler, Jacob" <j-stiffler@ti.com> wrote:
The software manifest is created by parsing the *.control files in the images /var/lib/opkg directory. For the nativesdk sysroot, there are some cases where the control files are not present. The reason for this and the specific circumstances of when this occurs has not yet been root caused.

When this does happen, the "Development Host Content" tables of the manifest are not valid. However, the package indexes are present. These contain all of the information in the control files, only concatenated together in a large file. This patch will split up these package indexes into individual control files which will allow the previous parsing to produce a valid output.


Here is an example of the invalid output when the control files are not present:

<h2><u>Development Host Content</u></h2>
<p>This table describes any software being delivered that is expected to run on a Development Host, instead of the target device.  Some of this software may be licensed under GPLv3 but it is not expected to be shipped as a product.</p>

<table border=1 cellspacing=1 cellpadding=1 width=80%>
<tr bgcolor=#c0c0c0  color=white>
    <td><b>Software Name</b></td>
    <td><b>Version</b></td>
    <td><b>License</b></td>
    <td><b>Location</b></td>
    <td><b>Delivered As</b></td>
    <td><b>Modified by TI</b></td>
    <td><b>Obtained from</b></td>
</tr>

<tr>
    <td> </td>
    <td></td>
    <td ></td>
    <td>__.ipk</td>
    <td>Binary</td>
    <td>No</td>
    <td></td>
</tr>


- Jake



-----Original Message-----
From: Dmytriyenko, Denys
Sent: Friday, March 06, 2015 5:48 PM
To: Cooper Jr., Franklin
Cc: Stiffler, Jacob; meta-arago@arago-project.org
Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.

Jake,

Can you please refresh my mind with more details of the problem? Thanks.


On Fri, Mar 06, 2015 at 08:49:10PM +0000, Cooper Jr., Franklin wrote:
> Ah I'm not aware of that since I never ran into the issue.
>
> > -----Original Message-----
> > From: Stiffler, Jacob
> > Sent: Friday, March 06, 2015 1:45 PM
> > To: Cooper Jr., Franklin; meta-arago@arago-project.org
> > Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest
> > generation for nativesdk.
> >
> > I ran into this issue in December. Denys also reported seeing the same issue.
> >
> > -----Original Message-----
> > From: Cooper Jr., Franklin
> > Sent: Friday, March 06, 2015 2:38 PM
> > To: Stiffler, Jacob; meta-arago@arago-project.org
> > Subject: RE: [meta-arago] [PATCH v2] tisdk-image: Fix manifest
> > generation for nativesdk.
> >
> > Don't know what the issue is especially since your saying that the
> > problem is on the build machine and not your local setup.
> >
> > I just made a release a little less than a month ago and haven't had
> > a problem on my local or build machine. Nothing important has
> > changed within oe-core in the last several months and nothing has
> > changed within oe-core within the last several months. Denys did
> > change the version of bitbake used by default but that wouldn't explain the different behavior between your machines.
> >
> > So it seems like the issue points to your build machine.
> >
> > > -----Original Message-----
> > > From: meta-arago-bounces@arago-project.org [mailto:meta-arago-
> > > bounces@arago-project.org] On Behalf Of Stiffler, Jacob
> > > Sent: Friday, March 06, 2015 1:26 PM
> > > To: meta-arago@arago-project.org
> > > Subject: Re: [meta-arago] [PATCH v2] tisdk-image: Fix manifest
> > > generation for nativesdk.
> > >
> > > I also need to revoke this patch. I forgot I am not able to
> > > recreate this issue on my local setup, and I have only seen it on the build machine.
> > >
> > > This patch will cause a build failure if any of the oe* package
> > > indexes are empty, as the " grep -n "^Package" $pkg_idx" will
> > > return an
> > error.
> > >
> > > Are there any other comments which I may address in the v3?
> > >
> > > Thanks,
> > > Jake
> > >
> > > -----Original Message-----
> > > From: Stiffler, Jacob
> > > Sent: Friday, March 06, 2015 9:34 AM
> > > To: meta-arago@arago-project.org
> > > Cc: Stiffler, Jacob
> > > Subject: [PATCH v2] tisdk-image: Fix manifest generation for nativesdk.
> > >
> > > * The manifest is automatically generated based on *.control
> > >   files found within the various images.
> > > * The control files for the nativesdk image have gone missing.
> > > * Work around this by regenerating the control files from the
> > >   package index.
> > >
> > > Signed-off-by: Jacob Stiffler <j-stiffler@ti.com>
> > > ---
> > > v2 changes:
> > > Parse all "oe*" package indexes instead of only "oe-*-nativesdk" indexes.
> > >
> > >
> > >  meta-arago-distro/classes/tisdk-image.bbclass |   37
> > > +++++++++++++++++++++++++
> > >  1 file changed, 37 insertions(+)
> > >
> > > diff --git a/meta-arago-distro/classes/tisdk-image.bbclass
> > > b/meta-arago- distro/classes/tisdk-image.bbclass
> > > index 3030a38..b9d86af 100644
> > > --- a/meta-arago-distro/classes/tisdk-image.bbclass
> > > +++ b/meta-arago-distro/classes/tisdk-image.bbclass
> > > @@ -353,6 +353,43 @@ echo "
> > >  </tr>
> > >  " >> ${SW_MANIFEST_FILE}
> > >
> > > +    control_files_there=0
> > > +    for possible_control_file in $control_dir/*.control
> > > +    do
> > > +        if [ -f $possible_control_file ]
> > > +        then
> > > +            control_files_there=1
> > > +            break
> > > +        fi
> > > +    done
> > > +
> > > +    if [ $control_files_there -eq 0 ]
> > > +    then
> > > +        for pkg_idx in $control_dir/oe*; do
> > > +            package_start=`grep -n "^Package" $pkg_idx`
> > > +
> > > +            IFS_OLD=${IFS}
> > > +            IFS="
> > > +"
> > > +
> > > +            for pkg in ${package_start}; do
> > > +                end=`echo $pkg | cut -d: -f1`
> > > +
> > > +                if [ -z $begin ]; then
> > > +                    pkg_name=`echo $pkg | cut -d: -f3`
> > > +                    begin=`echo $pkg | cut -d: -f1`
> > > +                    continue
> > > +                fi
> > > +                cnt=$[$cnt+1]
> > > +                head -n $[$end - 1] $pkg_idx | tail -n $[$end -
> > > + $begin] >
> > > ${control_dir}/${pkg_name// /}.control
> > > +
> > > +                pkg_name=`echo $pkg | cut -d: -f3`
> > > +                begin=$end
> > > +            done
> > > +            IFS=${IFS_OLD}
> > > +        done
> > > +    fi
> > > +
> > >      for i in $control_dir/*.control
> > >      do
> > >          package="`cat $i | grep Package: | awk {'print $2'}`"
> > > --
> > > 1.7.9.5
> > >
> > > _______________________________________________
> > > meta-arago mailing list
> > > meta-arago@arago-project.org
> > > http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago
> _______________________________________________
> meta-arago mailing list
> meta-arago@arago-project.org
> http://arago-project.org/cgi-bin/mailman/listinfo/meta-arago

[-- Attachment #2: Type: text/html, Size: 12342 bytes --]

^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2015-03-09 16:03 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-03-06 14:34 [PATCH v2] tisdk-image: Fix manifest generation for nativesdk Jacob Stiffler
2015-03-06 19:26 ` Stiffler, Jacob
2015-03-06 19:38   ` Cooper Jr., Franklin
2015-03-06 19:45     ` Stiffler, Jacob
2015-03-06 20:49       ` Cooper Jr., Franklin
2015-03-06 22:48         ` Denys Dmytriyenko
2015-03-09 13:49           ` Stiffler, Jacob
  -- strict thread matches above, loose matches on Subject: below --
2015-03-09 16:03 Dmytriyenko, Denys

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.