[denzil] Licenses, source distribution etc

[denzil] Licenses, source distribution etc

[Frans Meulenbroeks]

Dear all,

A next question/issue wrt my denzil experiment:

I wanted to know what licenses are used in my image.
I found tmp/deploy/licenses but this is package oriented and does not
really give a quick overview.

The manual gave me this section:
http://www.yoctoproject.org/docs/current/poky-ref-manual/poky-ref-manual.html#ref-classes-src-distribute

I tried to inherit src_distribute and src_distribute_local, but to no avail
Running a find on the source tree did not reveal these classes:

frans@frans-desktop:~/poky-denzil-7.0$ find | grep distribute
./meta/classes/pkg_distribute.bbclass
frans@frans-desktop:~/poky-denzil-7.0$

Something missing?
And what is the best way to find out what licenses are used?

Thanks, (and keep up the good work!)
Frans.

Re: [denzil] Licenses, source distribution etc

[Frans Meulenbroeks]

2012/5/8 Frans Meulenbroeks <fransmeulenbroeks@gmail.com>:
> Dear all,
>
> A next question/issue wrt my denzil experiment:
>
> I wanted to know what licenses are used in my image.
> I found tmp/deploy/licenses but this is package oriented and does not
> really give a quick overview.
>
> The manual gave me this section:
> http://www.yoctoproject.org/docs/current/poky-ref-manual/poky-ref-manual.html#ref-classes-src-distribute
>
> I tried to inherit src_distribute and src_distribute_local, but to no avail
> Running a find on the source tree did not reveal these classes:
>
> frans@frans-desktop:~/poky-denzil-7.0$ find | grep distribute
> ./meta/classes/pkg_distribute.bbclass
> frans@frans-desktop:~/poky-denzil-7.0$
>
> Something missing?
> And what is the best way to find out what licenses are used?
>
> Thanks, (and keep up the good work!)
> Frans.

Googled a little bit further.
Guess this is a documentation issue as the classes have been
deliberatly removed.
See http://patches.openembedded.org/patch/23171/

Frans

Re: [denzil] Licenses, source distribution etc

[Frans Meulenbroeks]

2012/5/8 Frans Meulenbroeks <fransmeulenbroeks@gmail.com>:
> 2012/5/8 Frans Meulenbroeks <fransmeulenbroeks@gmail.com>:
>> Dear all,
>>
>> A next question/issue wrt my denzil experiment:
>>
>> I wanted to know what licenses are used in my image.
>> I found tmp/deploy/licenses but this is package oriented and does not
>> really give a quick overview.
>>
>> The manual gave me this section:
>> http://www.yoctoproject.org/docs/current/poky-ref-manual/poky-ref-manual.html#ref-classes-src-distribute
>>
>> I tried to inherit src_distribute and src_distribute_local, but to no avail
>> Running a find on the source tree did not reveal these classes:
>>
>> frans@frans-desktop:~/poky-denzil-7.0$ find | grep distribute
>> ./meta/classes/pkg_distribute.bbclass
>> frans@frans-desktop:~/poky-denzil-7.0$
>>
>> Something missing?
>> And what is the best way to find out what licenses are used?
>>
>> Thanks, (and keep up the good work!)
>> Frans.
>
> Googled a little bit further.
> Guess this is a documentation issue as the classes have been
> deliberatly removed.
> See http://patches.openembedded.org/patch/23171/
>
> Frans

One more thing:
I've added the archiver class. I also have rm_work (not sure if that is related)
Now when running a build I get errors like this:

NOTE: Running task 1029 of 1279 (ID: 1167,
/home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
do_package_write_rpm)
NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Started
ERROR: Error executing a python function in
/home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb:
AttributeError: 'NoneType' object has no attribute 'upper'

ERROR: The stack trace of python calls that resulted in this
exception/failure was:
ERROR:   File "do_remove_tarball", line 14, in <module>
ERROR:
ERROR:   File "do_remove_tarball", line 3, in do_remove_tarball
ERROR:
ERROR: The code that was being executed was:
ERROR:      0010:		except (TypeError,OSError):
ERROR:      0011:				pass
ERROR:      0012:
ERROR:      0013:
ERROR:  *** 0014:do_remove_tarball(d)
ERROR:      0015:
ERROR: (file: 'do_remove_tarball', lineno: 14, function: <module>)
ERROR:      0001:
ERROR:      0002:def do_remove_tarball(d):
ERROR:  *** 0003:	if d.getVar('SOURCE_ARCHIVE_PACKAGE_TYPE',
True).upper() == 'SRPM':
ERROR:      0004:		work_dir = d.getVar('WORKDIR', True)
ERROR:      0005:		try:
ERROR:      0006:			for file in os.listdir(os.getcwd()):
ERROR:      0007:				if file in get_package(d):
ERROR: (file: 'do_remove_tarball', lineno: 3, function: do_remove_tarball)
ERROR: Function failed: do_remove_tarball
ERROR: Logfile of failure stored in:
/home/frans/poky-denzil-7.0-build/tmp/work/ppce300c3-poky-linux-uclibc/gettext-0.18.1.1-r11/temp/log.do_package_write_rpm.11248
NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Failed
ERROR: Task 1167
(/home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
do_package_write_rpm) failed with exit code '1'

And still no deploy/sources dir

Best regards, Frans

Re: [denzil] Licenses, source distribution etc

[Saul Wold]

On 05/08/2012 03:29 AM, Frans Meulenbroeks wrote:
> 2012/5/8 Frans Meulenbroeks<fransmeulenbroeks@gmail.com>:
>> 2012/5/8 Frans Meulenbroeks<fransmeulenbroeks@gmail.com>:
>>> Dear all,
>>>
>>> A next question/issue wrt my denzil experiment:
>>>
>>> I wanted to know what licenses are used in my image.
>>> I found tmp/deploy/licenses but this is package oriented and does not
>>> really give a quick overview.
>>>
>>> The manual gave me this section:
>>> http://www.yoctoproject.org/docs/current/poky-ref-manual/poky-ref-manual.html#ref-classes-src-distribute
>>>
>>> I tried to inherit src_distribute and src_distribute_local, but to no avail
>>> Running a find on the source tree did not reveal these classes:
>>>
>>> frans@frans-desktop:~/poky-denzil-7.0$ find | grep distribute
>>> ./meta/classes/pkg_distribute.bbclass
>>> frans@frans-desktop:~/poky-denzil-7.0$
>>>
>>> Something missing?
>>> And what is the best way to find out what licenses are used?
>>>
>>> Thanks, (and keep up the good work!)
>>> Frans.
>>
>> Googled a little bit further.
>> Guess this is a documentation issue as the classes have been
>> deliberatly removed.
>> See http://patches.openembedded.org/patch/23171/
>>
>> Frans
>
> One more thing:
> I've added the archiver class. I also have rm_work (not sure if that is related)
> Now when running a build I get errors like this:
>
> NOTE: Running task 1029 of 1279 (ID: 1167,
> /home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
> do_package_write_rpm)
> NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Started
> ERROR: Error executing a python function in
> /home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb:
> AttributeError: 'NoneType' object has no attribute 'upper'
>
> ERROR: The stack trace of python calls that resulted in this
> exception/failure was:
> ERROR:   File "do_remove_tarball", line 14, in<module>
> ERROR:
> ERROR:   File "do_remove_tarball", line 3, in do_remove_tarball
> ERROR:
> ERROR: The code that was being executed was:
> ERROR:      0010:		except (TypeError,OSError):
> ERROR:      0011:				pass
> ERROR:      0012:
> ERROR:      0013:
> ERROR:  *** 0014:do_remove_tarball(d)
> ERROR:      0015:
> ERROR: (file: 'do_remove_tarball', lineno: 14, function:<module>)
> ERROR:      0001:
> ERROR:      0002:def do_remove_tarball(d):
> ERROR:  *** 0003:	if d.getVar('SOURCE_ARCHIVE_PACKAGE_TYPE',
> True).upper() == 'SRPM':
> ERROR:      0004:		work_dir = d.getVar('WORKDIR', True)
> ERROR:      0005:		try:
> ERROR:      0006:			for file in os.listdir(os.getcwd()):
> ERROR:      0007:				if file in get_package(d):
> ERROR: (file: 'do_remove_tarball', lineno: 3, function: do_remove_tarball)
> ERROR: Function failed: do_remove_tarball
> ERROR: Logfile of failure stored in:
> /home/frans/poky-denzil-7.0-build/tmp/work/ppce300c3-poky-linux-uclibc/gettext-0.18.1.1-r11/temp/log.do_package_write_rpm.11248
> NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Failed
> ERROR: Task 1167
> (/home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
> do_package_write_rpm) failed with exit code '1'
>
> And still no deploy/sources dir
>
Frans Please file a bug against this and the src-distrubute class 
documentation.

Yes, we did rework the source archiving and I guess it was not tested as 
fully as it could have been.

Did you set SOURCE_ARCHIVE_PACKAGE_TYPE?

Sau!

> Best regards, Frans
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto
>
>

Re: [denzil] Licenses, source distribution etc

[Frans Meulenbroeks]

2012/5/8 Saul Wold <sgw@linux.intel.com>:
> On 05/08/2012 03:29 AM, Frans Meulenbroeks wrote:
>>
>> 2012/5/8 Frans Meulenbroeks<fransmeulenbroeks@gmail.com>:
>>>
>>> 2012/5/8 Frans Meulenbroeks<fransmeulenbroeks@gmail.com>:
>>>>
>>>> Dear all,
>>>>
>>>> A next question/issue wrt my denzil experiment:
>>>>
>>>> I wanted to know what licenses are used in my image.
>>>> I found tmp/deploy/licenses but this is package oriented and does not
>>>> really give a quick overview.
>>>>
>>>> The manual gave me this section:
>>>>
>>>> http://www.yoctoproject.org/docs/current/poky-ref-manual/poky-ref-manual.html#ref-classes-src-distribute
>>>>
>>>> I tried to inherit src_distribute and src_distribute_local, but to no
>>>> avail
>>>> Running a find on the source tree did not reveal these classes:
>>>>
>>>> frans@frans-desktop:~/poky-denzil-7.0$ find | grep distribute
>>>> ./meta/classes/pkg_distribute.bbclass
>>>> frans@frans-desktop:~/poky-denzil-7.0$
>>>>
>>>> Something missing?
>>>> And what is the best way to find out what licenses are used?
>>>>
>>>> Thanks, (and keep up the good work!)
>>>> Frans.
>>>
>>>
>>> Googled a little bit further.
>>> Guess this is a documentation issue as the classes have been
>>> deliberatly removed.
>>> See http://patches.openembedded.org/patch/23171/
>>>
>>> Frans
>>
>>
>> One more thing:
>> I've added the archiver class. I also have rm_work (not sure if that is
>> related)
>> Now when running a build I get errors like this:
>>
>> NOTE: Running task 1029 of 1279 (ID: 1167,
>> /home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
>> do_package_write_rpm)
>> NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Started
>> ERROR: Error executing a python function in
>> /home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb:
>> AttributeError: 'NoneType' object has no attribute 'upper'
>>
>> ERROR: The stack trace of python calls that resulted in this
>> exception/failure was:
>> ERROR:   File "do_remove_tarball", line 14, in<module>
>> ERROR:
>> ERROR:   File "do_remove_tarball", line 3, in do_remove_tarball
>> ERROR:
>> ERROR: The code that was being executed was:
>> ERROR:      0010:               except (TypeError,OSError):
>> ERROR:      0011:                               pass
>> ERROR:      0012:
>> ERROR:      0013:
>> ERROR:  *** 0014:do_remove_tarball(d)
>> ERROR:      0015:
>> ERROR: (file: 'do_remove_tarball', lineno: 14, function:<module>)
>> ERROR:      0001:
>> ERROR:      0002:def do_remove_tarball(d):
>> ERROR:  *** 0003:       if d.getVar('SOURCE_ARCHIVE_PACKAGE_TYPE',
>> True).upper() == 'SRPM':
>> ERROR:      0004:               work_dir = d.getVar('WORKDIR', True)
>> ERROR:      0005:               try:
>> ERROR:      0006:                       for file in
>> os.listdir(os.getcwd()):
>> ERROR:      0007:                               if file in get_package(d):
>> ERROR: (file: 'do_remove_tarball', lineno: 3, function: do_remove_tarball)
>> ERROR: Function failed: do_remove_tarball
>> ERROR: Logfile of failure stored in:
>>
>> /home/frans/poky-denzil-7.0-build/tmp/work/ppce300c3-poky-linux-uclibc/gettext-0.18.1.1-r11/temp/log.do_package_write_rpm.11248
>> NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Failed
>> ERROR: Task 1167
>>
>> (/home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
>> do_package_write_rpm) failed with exit code '1'
>>
>> And still no deploy/sources dir
>>
> Frans Please file a bug against this and the src-distrubute class
> documentation.
>
> Yes, we did rework the source archiving and I guess it was not tested as
> fully as it could have been.
>
> Did you set SOURCE_ARCHIVE_PACKAGE_TYPE?
>
> Sau!
>

Elizabeth, thhanks for the reference

Saul, I did not set  SOURCE_ARCHIVE_PACKAGE_TYPE. I assume that is the problem.
Maybe this should get a sensible default or a warning if not set or it
could skip the source tarball

Best regards, Frans

Re: [denzil] Licenses, source distribution etc

[Yes Yanus]

[-- Attachment #1: Type: text/plain, Size: 4703 bytes --]





________________________________
 From: Frans Meulenbroeks <fransmeulenbroeks@gmail.com>
To: Saul Wold <sgw@linux.intel.com> 
Cc: yocto@yoctoproject.org 
Sent: Wednesday, May 9, 2012 1:17 AM
Subject: Re: [yocto] [denzil] Licenses, source distribution etc
 
2012/5/8 Saul Wold <sgw@linux.intel.com>:
> On 05/08/2012 03:29 AM, Frans Meulenbroeks wrote:
>>
>> 2012/5/8 Frans Meulenbroeks<fransmeulenbroeks@gmail.com>:
>>>
>>> 2012/5/8 Frans Meulenbroeks<fransmeulenbroeks@gmail.com>:
>>>>
>>>> Dear all,
>>>>
>>>> A next question/issue wrt my denzil experiment:
>>>>
>>>> I wanted to know what licenses are used in my image.
>>>> I found tmp/deploy/licenses but this is package oriented and does not
>>>> really give a quick overview.
>>>>
>>>> The manual gave me this section:
>>>>
>>>> http://www.yoctoproject.org/docs/current/poky-ref-manual/poky-ref-manual.html#ref-classes-src-distribute
>>>>
>>>> I tried to inherit src_distribute and src_distribute_local, but to no
>>>> avail
>>>> Running a find on the source tree did not reveal these classes:
>>>>
>>>> frans@frans-desktop:~/poky-denzil-7.0$ find | grep distribute
>>>> ./meta/classes/pkg_distribute.bbclass
>>>> frans@frans-desktop:~/poky-denzil-7.0$
>>>>
>>>> Something missing?
>>>> And what is the best way to find out what licenses are used?
>>>>
>>>> Thanks, (and keep up the good work!)
>>>> Frans.
>>>
>>>
>>> Googled a little bit further.
>>> Guess this is a documentation issue as the classes have been
>>> deliberatly removed.
>>> See http://patches.openembedded.org/patch/23171/
>>>
>>> Frans
>>
>>
>> One more thing:
>> I've added the archiver class. I also have rm_work (not sure if that is
>> related)
>> Now when running a build I get errors like this:
>>
>> NOTE: Running task 1029 of 1279 (ID: 1167,
>> /home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
>> do_package_write_rpm)
>> NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Started
>> ERROR: Error executing a python function in
>> /home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb:
>> AttributeError: 'NoneType' object has no attribute 'upper'
>>
>> ERROR: The stack trace of python calls that resulted in this
>> exception/failure was:
>> ERROR:   File "do_remove_tarball", line 14, in<module>
>> ERROR:
>> ERROR:   File "do_remove_tarball", line 3, in do_remove_tarball
>> ERROR:
>> ERROR: The code that was being executed was:
>> ERROR:      0010:               except (TypeError,OSError):
>> ERROR:      0011:                               pass
>> ERROR:      0012:
>> ERROR:      0013:
>> ERROR:  *** 0014:do_remove_tarball(d)
>> ERROR:      0015:
>> ERROR: (file: 'do_remove_tarball', lineno: 14, function:<module>)
>> ERROR:      0001:
>> ERROR:      0002:def do_remove_tarball(d):
>> ERROR:  *** 0003:       if d.getVar('SOURCE_ARCHIVE_PACKAGE_TYPE',
>> True).upper() == 'SRPM':
>> ERROR:      0004:               work_dir = d.getVar('WORKDIR', True)
>> ERROR:      0005:               try:
>> ERROR:      0006:                       for file in
>> os.listdir(os.getcwd()):
>> ERROR:      0007:                               if file in get_package(d):
>> ERROR: (file: 'do_remove_tarball', lineno: 3, function: do_remove_tarball)
>> ERROR: Function failed: do_remove_tarball
>> ERROR: Logfile of failure stored in:
>>
>> /home/frans/poky-denzil-7.0-build/tmp/work/ppce300c3-poky-linux-uclibc/gettext-0.18.1.1-r11/temp/log.do_package_write_rpm.11248
>> NOTE: package gettext-0.18.1.1-r11: task do_package_write_rpm: Failed
>> ERROR: Task 1167
>>
>> (/home/frans/poky-denzil-7.0/meta/recipes-core/gettext/gettext_0.18.1.1.bb,
>> do_package_write_rpm) failed with exit code '1'
>>
>> And still no deploy/sources dir
>>
> Frans Please file a bug against this and the src-distrubute class
> documentation.
>
> Yes, we did rework the source archiving and I guess it was not tested as
> fully as it could have been.
>
> Did you set SOURCE_ARCHIVE_PACKAGE_TYPE?
>
> Sau!
>

>Elizabeth, thhanks for the reference

>Saul, I did not set  SOURCE_ARCHIVE_PACKAGE_TYPE. I assume that is the problem.
>Maybe this should get a sensible default or a warning if not set or it
>could skip the source tarball

If you use archiver.bbclass , you should enable three variables 
INHERIT += "archive-original-source"
SOURCE_ARCHIVE_PACKAGE_TYPE = 'srpm' or 'tar'

SOURCE_ARCHIVE_LOG_WITH_SCRIPTS ?= 'logs_with_scripts' or 'logs'

>Best regards, Frans
>_______________________________________________
>yocto mailing list
>yocto@yoctoproject.org
>https://lists.yoctoproject.org/listinfo/yocto

[-- Attachment #2: Type: text/html, Size: 8043 bytes --]

Re: [denzil] Licenses, source distribution etc

[Frans Meulenbroeks]

2012/5/9 Yes Yanus <yesyanus@yahoo.com>:
>

>
> If you use archiver.bbclass , you should enable three variables
> INHERIT += "archive-original-source"
> SOURCE_ARCHIVE_PACKAGE_TYPE = 'srpm' or 'tar'
> SOURCE_ARCHIVE_LOG_WITH_SCRIPTS ?= 'logs_with_scripts' or 'logs'
>


Thanks. I'll try that.
Originally I had only INHERIT += "archiver"

Best regards, Frans

Re: [denzil] Licenses, source distribution etc

[Xiaofeng Yan]

On 2012年05月09日 14:01, Frans Meulenbroeks wrote:
> 2012/5/9 Yes Yanus<yesyanus@yahoo.com>:
>> If you use archiver.bbclass , you should enable three variables
>> INHERIT += "archive-original-source"
>> SOURCE_ARCHIVE_PACKAGE_TYPE = 'srpm' or 'tar'
>> SOURCE_ARCHIVE_LOG_WITH_SCRIPTS ?= 'logs_with_scripts' or 'logs'
>>
>
> Thanks. I'll try that.
> Originally I had only INHERIT += "archiver"
Hi Frans,

Thanks for your information. I will update archiver.bbclass with 
stronger coding.
you will get more description after reading 
meta-yocto/conf/local.conf.sample.
> Best regards, Frans
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto
>

Re: [denzil] Licenses, source distribution etc

[Flanagan, Elizabeth]

On Tue, May 8, 2012 at 12:57 AM, Frans Meulenbroeks
<fransmeulenbroeks@gmail.com> wrote:
> Dear all,
>
> A next question/issue wrt my denzil experiment:
>
> I wanted to know what licenses are used in my image.
> I found tmp/deploy/licenses but this is package oriented and does not
> really give a quick overview.
>
> The manual gave me this section:
> http://www.yoctoproject.org/docs/current/poky-ref-manual/poky-ref-manual.html#ref-classes-src-distribute
>
> I tried to inherit src_distribute and src_distribute_local, but to no avail
> Running a find on the source tree did not reveal these classes:
>
> frans@frans-desktop:~/poky-denzil-7.0$ find | grep distribute
> ./meta/classes/pkg_distribute.bbclass
> frans@frans-desktop:~/poky-denzil-7.0$
>
> Something missing?
> And what is the best way to find out what licenses are used?

tmp/deploy/${IMAGE}/license.manifest

I have a bug open to document the license infrastructure.

-b

>
> Thanks, (and keep up the good work!)
> Frans.
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto



-- 
Elizabeth Flanagan
Yocto Project
Build and Release

Re: [denzil] Licenses, source distribution etc

[Frans Meulenbroeks]

2012/5/8 Flanagan, Elizabeth <elizabeth.flanagan@intel.com>:

>>
>> Something missing?
>> And what is the best way to find out what licenses are used?
>
> tmp/deploy/${IMAGE}/license.manifest
>
> I have a bug open to document the license infrastructure.

Elizabeth, thanks for your reply.
I peeked in my tree, actually it seems to be something like
tmp/deploy/licenses/${IMAGE}/license.manifest

It would be nice if there would also be a file per license (so you can
see quickly what e.g. GPLv2 licensed software you have).
Also it would be nice if the license.manifest file contained the
version number of the package (especially nice if the license has
changed over time)
I'll file feature requests for this.

Frans