Re: [oe-commits] Morgan Little : python: Update for python-native changes

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 5650 bytes --]

On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> Module: openembedded-core.git
> Branch: master
> Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> 
> Author: Morgan Little <morgan.little@windriver.com>
> Date:   Thu Jul 19 13:46:07 2012 -0400
> 
> python: Update for python-native changes
> 
> Add pythonnative onto the list of inherits and update the paths to the binaries
> referenced in the recipe to the new paths.
> 
> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> 

Any idea why is opkg package-index now failing _sometimes_ ?

| + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
| + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
| + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
| Traceback (most recent call last):
|   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
|     main()
|   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
|     known_paths = addsitepackages(known_paths)
|   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
|     for sitedir in getsitepackages():
|   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
|     sitepackages.append(os.path.join(prefix, sys.lib,
| AttributeError: 'module' object has no attribute 'lib'
| ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
NOTE: package package-index-1.0-r0: task do_package_index: Failed

Cheers,

> ---
> 
>  meta/recipes-devtools/python/python_2.7.3.bb |   18 +++++++++---------
>  1 files changed, 9 insertions(+), 9 deletions(-)
> 
> diff --git a/meta/recipes-devtools/python/python_2.7.3.bb b/meta/recipes-devtools/python/python_2.7.3.bb
> index b736cc2..d27ff05 100644
> --- a/meta/recipes-devtools/python/python_2.7.3.bb
> +++ b/meta/recipes-devtools/python/python_2.7.3.bb
> @@ -1,6 +1,6 @@
>  require python.inc
>  DEPENDS = "python-native bzip2 db gdbm openssl readline sqlite3 zlib"
> -PR = "${INC_PR}.0"
> +PR = "${INC_PR}.1"
>  
>  DISTRO_SRC_URI ?= "file://sitecustomize.py"
>  DISTRO_SRC_URI_linuxstdbase = ""
> @@ -30,7 +30,7 @@ SRC_URI += "\
>  
>  S = "${WORKDIR}/Python-${PV}"
>  
> -inherit autotools multilib_header
> +inherit autotools multilib_header pythonnative
>  
>  # The 3 lines below are copied from the libffi recipe, ctypes ships its own copy of the libffi sources
>  #Somehow gcc doesn't set __SOFTFP__ when passing -mfloatabi=softp :(
> @@ -45,7 +45,7 @@ do_configure_prepend() {
>  do_compile() {
>          # regenerate platform specific files, because they depend on system headers
>          cd Lib/plat-linux2
> -        include=${STAGING_INCDIR} ${STAGING_BINDIR_NATIVE}/python \
> +        include=${STAGING_INCDIR} ${STAGING_BINDIR_NATIVE}/python-native/python \
>                  ${S}/Tools/scripts/h2py.py -i '(u_long)' \
>                  ${STAGING_INCDIR}/dlfcn.h \
>                  ${STAGING_INCDIR}/linux/cdrom.h \
> @@ -89,8 +89,8 @@ do_compile() {
>  
>  	export CROSS_COMPILE="${TARGET_PREFIX}"
>  
> -	oe_runmake HOSTPGEN=${STAGING_BINDIR_NATIVE}/pgen \
> -		HOSTPYTHON=${STAGING_BINDIR_NATIVE}/python \
> +	oe_runmake HOSTPGEN=${STAGING_BINDIR_NATIVE}/python-native/pgen \
> +		HOSTPYTHON=${STAGING_BINDIR_NATIVE}/python-native/python \
>  		STAGING_LIBDIR=${STAGING_LIBDIR} \
>  		STAGING_BASELIBDIR=${STAGING_BASELIBDIR} \
>  		STAGING_INCDIR=${STAGING_INCDIR} \
> @@ -99,8 +99,8 @@ do_compile() {
>  
>  	oe_libinstall -so libpython${PYTHON_MAJMIN} ${STAGING_LIBDIR}
>  
> -	oe_runmake HOSTPGEN=${STAGING_BINDIR_NATIVE}/pgen \
> -		HOSTPYTHON=${STAGING_BINDIR_NATIVE}/python \
> +	oe_runmake HOSTPGEN=${STAGING_BINDIR_NATIVE}/python-native/pgen \
> +		HOSTPYTHON=${STAGING_BINDIR_NATIVE}/python-native/python \
>  		STAGING_LIBDIR=${STAGING_LIBDIR} \
>  		STAGING_INCDIR=${STAGING_INCDIR} \
>  		STAGING_BASELIBDIR=${STAGING_BASELIBDIR} \
> @@ -115,8 +115,8 @@ do_install() {
>  
>  	export CROSS_COMPILE="${TARGET_PREFIX}"
>  	
> -	oe_runmake HOSTPGEN=${STAGING_BINDIR_NATIVE}/pgen \
> -		HOSTPYTHON=${STAGING_BINDIR_NATIVE}/python \
> +	oe_runmake HOSTPGEN=${STAGING_BINDIR_NATIVE}/python-native/pgen \
> +		HOSTPYTHON=${STAGING_BINDIR_NATIVE}/python-native/python \
>  		CROSSPYTHONPATH=${STAGING_LIBDIR_NATIVE}/python${PYTHON_MAJMIN}/lib-dynload/ \
>  		STAGING_LIBDIR=${STAGING_LIBDIR} \
>  		STAGING_INCDIR=${STAGING_INCDIR} \
> 
> 
> _______________________________________________
> Openembedded-commits mailing list
> Openembedded-commits@lists.openembedded.org
> http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/openembedded-commits

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Richard Purdie]

On Mon, 2012-07-23 at 13:18 +0200, Martin Jansa wrote:
> On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> > Module: openembedded-core.git
> > Branch: master
> > Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> > URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> > 
> > Author: Morgan Little <morgan.little@windriver.com>
> > Date:   Thu Jul 19 13:46:07 2012 -0400
> > 
> > python: Update for python-native changes
> > 
> > Add pythonnative onto the list of inherits and update the paths to the binaries
> > referenced in the recipe to the new paths.
> > 
> > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > 
> 
> Any idea why is opkg package-index now failing _sometimes_ ?
> 
> | + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
> | + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
> | + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
> | Traceback (most recent call last):
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
> |     main()
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
> |     known_paths = addsitepackages(known_paths)
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
> |     for sitedir in getsitepackages():
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
> |     sitepackages.append(os.path.join(prefix, sys.lib,
> | AttributeError: 'module' object has no attribute 'lib'
> | ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
> NOTE: package package-index-1.0-r0: task do_package_index: Failed

What is the header of opkg-make-index? Is it a path to python or
a /usr/bin/env python?

Cheers,

Richard

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 3196 bytes --]

On Mon, Jul 23, 2012 at 12:32:55PM +0100, Richard Purdie wrote:
> On Mon, 2012-07-23 at 13:18 +0200, Martin Jansa wrote:
> > On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> > > Module: openembedded-core.git
> > > Branch: master
> > > Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > 
> > > Author: Morgan Little <morgan.little@windriver.com>
> > > Date:   Thu Jul 19 13:46:07 2012 -0400
> > > 
> > > python: Update for python-native changes
> > > 
> > > Add pythonnative onto the list of inherits and update the paths to the binaries
> > > referenced in the recipe to the new paths.
> > > 
> > > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > 
> > 
> > Any idea why is opkg package-index now failing _sometimes_ ?
> > 
> > | + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
> > | + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
> > | + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
> > | Traceback (most recent call last):
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
> > |     main()
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
> > |     known_paths = addsitepackages(known_paths)
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
> > |     for sitedir in getsitepackages():
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
> > |     sitepackages.append(os.path.join(prefix, sys.lib,
> > | AttributeError: 'module' object has no attribute 'lib'
> > | ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
> > NOTE: package package-index-1.0-r0: task do_package_index: Failed
> 
> What is the header of opkg-make-index? Is it a path to python or
> a /usr/bin/env python?

$ head -n1 jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/opkg-make-index
#!/usr/bin/env python

Cheers,

> 
> Cheers,
> 
> Richard
> 
> 
> 
> _______________________________________________
> Openembedded-core mailing list
> Openembedded-core@lists.openembedded.org
> http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/openembedded-core

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Richard Purdie]

On Mon, 2012-07-23 at 13:37 +0200, Martin Jansa wrote:
> On Mon, Jul 23, 2012 at 12:32:55PM +0100, Richard Purdie wrote:
> > On Mon, 2012-07-23 at 13:18 +0200, Martin Jansa wrote:
> > > On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> > > > Module: openembedded-core.git
> > > > Branch: master
> > > > Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > > URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > > 
> > > > Author: Morgan Little <morgan.little@windriver.com>
> > > > Date:   Thu Jul 19 13:46:07 2012 -0400
> > > > 
> > > > python: Update for python-native changes
> > > > 
> > > > Add pythonnative onto the list of inherits and update the paths to the binaries
> > > > referenced in the recipe to the new paths.
> > > > 
> > > > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > > 
> > > 
> > > Any idea why is opkg package-index now failing _sometimes_ ?
> > > 
> > > | + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
> > > | + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
> > > | + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
> > > | Traceback (most recent call last):
> > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
> > > |     main()
> > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
> > > |     known_paths = addsitepackages(known_paths)
> > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
> > > |     for sitedir in getsitepackages():
> > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
> > > |     sitepackages.append(os.path.join(prefix, sys.lib,
> > > | AttributeError: 'module' object has no attribute 'lib'
> > > | ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
> > > NOTE: package package-index-1.0-r0: task do_package_index: Failed
> > 
> > What is the header of opkg-make-index? Is it a path to python or
> > a /usr/bin/env python?
> 
> $ head -n1 jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/opkg-make-index
> #!/usr/bin/env python

package-index doesn't inherit pythonnative. The python found from env
would therefore be the host system python but its using files from the
sysroot. Mixing the two is a bad idea.

The question is how is it mixing these up, the host system python
shouldn't be looking there for modules.

So I'm not sure why they're getting mixed up but its likely the problem.
Does anything jump out at you on the machine in question with the above
in mind?

Cheers,

Richard

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 4034 bytes --]

On Mon, Jul 23, 2012 at 02:02:12PM +0100, Richard Purdie wrote:
> On Mon, 2012-07-23 at 13:37 +0200, Martin Jansa wrote:
> > On Mon, Jul 23, 2012 at 12:32:55PM +0100, Richard Purdie wrote:
> > > On Mon, 2012-07-23 at 13:18 +0200, Martin Jansa wrote:
> > > > On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> > > > > Module: openembedded-core.git
> > > > > Branch: master
> > > > > Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > > > URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > > > 
> > > > > Author: Morgan Little <morgan.little@windriver.com>
> > > > > Date:   Thu Jul 19 13:46:07 2012 -0400
> > > > > 
> > > > > python: Update for python-native changes
> > > > > 
> > > > > Add pythonnative onto the list of inherits and update the paths to the binaries
> > > > > referenced in the recipe to the new paths.
> > > > > 
> > > > > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > > > 
> > > > 
> > > > Any idea why is opkg package-index now failing _sometimes_ ?
> > > > 
> > > > | + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
> > > > | + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
> > > > | + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
> > > > | Traceback (most recent call last):
> > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
> > > > |     main()
> > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
> > > > |     known_paths = addsitepackages(known_paths)
> > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
> > > > |     for sitedir in getsitepackages():
> > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
> > > > |     sitepackages.append(os.path.join(prefix, sys.lib,
> > > > | AttributeError: 'module' object has no attribute 'lib'
> > > > | ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
> > > > NOTE: package package-index-1.0-r0: task do_package_index: Failed
> > > 
> > > What is the header of opkg-make-index? Is it a path to python or
> > > a /usr/bin/env python?
> > 
> > $ head -n1 jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/opkg-make-index
> > #!/usr/bin/env python
> 
> package-index doesn't inherit pythonnative. The python found from env
> would therefore be the host system python but its using files from the
> sysroot. Mixing the two is a bad idea.
> 
> The question is how is it mixing these up, the host system python
> shouldn't be looking there for modules.
> 
> So I'm not sure why they're getting mixed up but its likely the problem.
> Does anything jump out at you on the machine in question with the above
> in mind?

Not really and it happens only in some builds (all today - haven't seen
this error before) and sofar it failed in 4/10 image/feed builds and
worked in remaining 6.

Even for the same combination of MACHINE and target it once worked and once
failed without any metadata changes or host distro changes between.

Cheers,

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 4458 bytes --]

On Mon, Jul 23, 2012 at 03:06:12PM +0200, Martin Jansa wrote:
> On Mon, Jul 23, 2012 at 02:02:12PM +0100, Richard Purdie wrote:
> > On Mon, 2012-07-23 at 13:37 +0200, Martin Jansa wrote:
> > > On Mon, Jul 23, 2012 at 12:32:55PM +0100, Richard Purdie wrote:
> > > > On Mon, 2012-07-23 at 13:18 +0200, Martin Jansa wrote:
> > > > > On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> > > > > > Module: openembedded-core.git
> > > > > > Branch: master
> > > > > > Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > > > > URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > > > > 
> > > > > > Author: Morgan Little <morgan.little@windriver.com>
> > > > > > Date:   Thu Jul 19 13:46:07 2012 -0400
> > > > > > 
> > > > > > python: Update for python-native changes
> > > > > > 
> > > > > > Add pythonnative onto the list of inherits and update the paths to the binaries
> > > > > > referenced in the recipe to the new paths.
> > > > > > 
> > > > > > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > > > > 
> > > > > 
> > > > > Any idea why is opkg package-index now failing _sometimes_ ?
> > > > > 
> > > > > | + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
> > > > > | + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
> > > > > | + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
> > > > > | Traceback (most recent call last):
> > > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
> > > > > |     main()
> > > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
> > > > > |     known_paths = addsitepackages(known_paths)
> > > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
> > > > > |     for sitedir in getsitepackages():
> > > > > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
> > > > > |     sitepackages.append(os.path.join(prefix, sys.lib,
> > > > > | AttributeError: 'module' object has no attribute 'lib'
> > > > > | ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
> > > > > NOTE: package package-index-1.0-r0: task do_package_index: Failed
> > > > 
> > > > What is the header of opkg-make-index? Is it a path to python or
> > > > a /usr/bin/env python?
> > > 
> > > $ head -n1 jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/bin/opkg-make-index
> > > #!/usr/bin/env python
> > 
> > package-index doesn't inherit pythonnative. The python found from env
> > would therefore be the host system python but its using files from the
> > sysroot. Mixing the two is a bad idea.
> > 
> > The question is how is it mixing these up, the host system python
> > shouldn't be looking there for modules.
> > 
> > So I'm not sure why they're getting mixed up but its likely the problem.
> > Does anything jump out at you on the machine in question with the above
> > in mind?
> 
> Not really and it happens only in some builds (all today - haven't seen
> this error before) and sofar it failed in 4/10 image/feed builds and
> worked in remaining 6.
> 
> Even for the same combination of MACHINE and target it once worked and once
> failed without any metadata changes or host distro changes between.

env doesn't show anything interesting related to python

changing shebang to
path/tmp-eglibc/sysroots/x86_64-linux/usr/bin/python-native/python

made all currently failing builds to succeed again, but the issue is
still there..

Cheers,

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Richard Purdie]

On Tue, 2012-07-24 at 09:57 +0200, Martin Jansa wrote:
> On Mon, Jul 23, 2012 at 03:06:12PM +0200, Martin Jansa wrote:
> > On Mon, Jul 23, 2012 at 02:02:12PM +0100, Richard Purdie wrote:
> > > On Mon, 2012-07-23 at 13:37 +0200, Martin Jansa wrote:
> > > > On Mon, Jul 23, 2012 at 12:32:55PM +0100, Richard Purdie wrote:
> > > package-index doesn't inherit pythonnative. The python found from env
> > > would therefore be the host system python but its using files from the
> > > sysroot. Mixing the two is a bad idea.
> > > 
> > > The question is how is it mixing these up, the host system python
> > > shouldn't be looking there for modules.
> > > 
> > > So I'm not sure why they're getting mixed up but its likely the problem.
> > > Does anything jump out at you on the machine in question with the above
> > > in mind?
> > 
> > Not really and it happens only in some builds (all today - haven't seen
> > this error before) and sofar it failed in 4/10 image/feed builds and
> > worked in remaining 6.
> > 
> > Even for the same combination of MACHINE and target it once worked and once
> > failed without any metadata changes or host distro changes between.
> 
> env doesn't show anything interesting related to python
> 
> changing shebang to
> path/tmp-eglibc/sysroots/x86_64-linux/usr/bin/python-native/python
> 
> made all currently failing builds to succeed again, but the issue is
> still there..

Is this on the same build machine? There must be something in common
with the failed builds. Do they always fail if you
hardcode /usr/bin/python in there? If so, can we figure out why the host
python is looking at files in the sysroot? LD_LIBRARY_PATH isn't set or
something odd like that?

Cheers,

Richard

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 2512 bytes --]

On Tue, Jul 24, 2012 at 09:17:26AM +0100, Richard Purdie wrote:
> On Tue, 2012-07-24 at 09:57 +0200, Martin Jansa wrote:
> > On Mon, Jul 23, 2012 at 03:06:12PM +0200, Martin Jansa wrote:
> > > On Mon, Jul 23, 2012 at 02:02:12PM +0100, Richard Purdie wrote:
> > > > On Mon, 2012-07-23 at 13:37 +0200, Martin Jansa wrote:
> > > > > On Mon, Jul 23, 2012 at 12:32:55PM +0100, Richard Purdie wrote:
> > > > package-index doesn't inherit pythonnative. The python found from env
> > > > would therefore be the host system python but its using files from the
> > > > sysroot. Mixing the two is a bad idea.
> > > > 
> > > > The question is how is it mixing these up, the host system python
> > > > shouldn't be looking there for modules.
> > > > 
> > > > So I'm not sure why they're getting mixed up but its likely the problem.
> > > > Does anything jump out at you on the machine in question with the above
> > > > in mind?
> > > 
> > > Not really and it happens only in some builds (all today - haven't seen
> > > this error before) and sofar it failed in 4/10 image/feed builds and
> > > worked in remaining 6.
> > > 
> > > Even for the same combination of MACHINE and target it once worked and once
> > > failed without any metadata changes or host distro changes between.
> > 
> > env doesn't show anything interesting related to python
> > 
> > changing shebang to
> > path/tmp-eglibc/sysroots/x86_64-linux/usr/bin/python-native/python
> > 
> > made all currently failing builds to succeed again, but the issue is
> > still there..
> 
> Is this on the same build machine? There must be something in common
> with the failed builds. Do they always fail if you

Yes, same machine same builddir..

One failing image succeeded later, the remaining 3 are: 1 image
(bitbake shr-image) and 2 bitbake package-index tasks (which are called after
bitbake task-shr-feed is finished).

I'm doing 8 image builds + 4 feed builds in 2 separate builddirs there.
All about 3 times already since yesterday.

So I don't see anything special on those 3 failing :/.

> hardcode /usr/bin/python in there? If so, can we figure out why the host

With hardcoded /usr/bin/python it was failing, then I've tried to
hardcode that python-native which worked.

> python is looking at files in the sysroot? LD_LIBRARY_PATH isn't set or
> something odd like that?

LD_LIBRARY_PATH is set to empty in setup-env script.

Cheers,

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

[PATCH] opkg-utils: inherit pythonnative

[Martin Jansa]

Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
---
 meta/recipes-devtools/opkg-utils/opkg-utils_git.bb |    4 +++-
 1 files changed, 3 insertions(+), 1 deletions(-)

diff --git a/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb b/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb
index 92e6624..caa66f7 100644
--- a/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb
+++ b/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb
@@ -8,7 +8,9 @@ RDEPENDS_${PN} = "python"
 RDEPENDS_${PN}_virtclass-native = ""
 SRCREV = "49cc783d8e0415059d126ae22c892988717ffda7"
 PV = "0.1.8+git${SRCPV}"
-PR = "r0"
+PR = "r1"
+
+inherit pythonnative
 
 SRC_URI = "git://git.yoctoproject.org/opkg-utils;protocol=git \
            "
-- 
1.7.8.6

Re: [PATCH] opkg-utils: inherit pythonnative

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 1031 bytes --]

On Sun, Aug 05, 2012 at 12:24:12PM +0200, Martin Jansa wrote:
> Signed-off-by: Martin Jansa <Martin.Jansa@gmail.com>
> ---
>  meta/recipes-devtools/opkg-utils/opkg-utils_git.bb |    4 +++-
>  1 files changed, 3 insertions(+), 1 deletions(-)
> 
> diff --git a/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb b/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb
> index 92e6624..caa66f7 100644
> --- a/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb
> +++ b/meta/recipes-devtools/opkg-utils/opkg-utils_git.bb
> @@ -8,7 +8,9 @@ RDEPENDS_${PN} = "python"
>  RDEPENDS_${PN}_virtclass-native = ""
>  SRCREV = "49cc783d8e0415059d126ae22c892988717ffda7"
>  PV = "0.1.8+git${SRCPV}"
> -PR = "r0"
> +PR = "r1"
> +
> +inherit pythonnative
>  
>  SRC_URI = "git://git.yoctoproject.org/opkg-utils;protocol=git \
>             "

Please ignore this patch, this needs to be in package-index recipe (and
I had both patches when testing this :/)

Cheers,
-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 5464 bytes --]

On Mon, Jul 23, 2012 at 01:18:29PM +0200, Martin Jansa wrote:
> On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> > Module: openembedded-core.git
> > Branch: master
> > Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> > URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> > 
> > Author: Morgan Little <morgan.little@windriver.com>
> > Date:   Thu Jul 19 13:46:07 2012 -0400
> > 
> > python: Update for python-native changes
> > 
> > Add pythonnative onto the list of inherits and update the paths to the binaries
> > referenced in the recipe to the new paths.
> > 
> > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > 
> 
> Any idea why is opkg package-index now failing _sometimes_ ?
> 
> | + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
> | + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
> | + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
> | Traceback (most recent call last):
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
> |     main()
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
> |     known_paths = addsitepackages(known_paths)
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
> |     for sitedir in getsitepackages():
> |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
> |     sitepackages.append(os.path.join(prefix, sys.lib,
> | AttributeError: 'module' object has no attribute 'lib'
> | ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
> NOTE: package package-index-1.0-r0: task do_package_index: Failed

similar issue when building libxcb (http://pastie.org/4352949), works after applying

http://patchwork.openembedded.org/patch/31987/
http://patchwork.openembedded.org/patch/31977/

and bitbake -c cleansstate libxcb-native libxcb xcb-proto-native xcb-proto to rebuild them (missing PR bumps).

Cheers,

NOTE: package inputproto-1_2.2-r0: task do_populate_sysroot: Started
ERROR: Function failed: do_compile (see /OE/shr-core/tmp-eglibc/work/armv7a-vfp-neon-oe-linux-gnueabi/libxcb/libxcb-1.8.1-r0/temp/log.do_compile.17687 for further information)
ERROR: Logfile of failure stored in: /OE/shr-core/tmp-eglibc/work/armv7a-vfp-neon-oe-linux-gnueabi/libxcb/libxcb-1.8.1-r0/temp/log.do_compile.17687
Log data follows:
| DEBUG: SITE files ['endian-little', 'bit-32', 'arm-common', 'common-linux', 'common-glibc', 'arm-linux', 'arm-linux-gnueabi', 'common']
| DEBUG: Executing shell function do_compile
| NOTE: make
| Making all in src
| make[1]: Entering directory `/OE/shr-core/tmp-eglibc/work/armv7a-vfp-neon-oe-linux-gnueabi/libxcb/libxcb-1.8.1-r0/libxcb-1.8.1/src'
| /usr/bin/python ./c_client.py -p /OE/shr-core/tmp-eglibc/sysroots/crespo//usr/lib64/python2.7/site-packages /OE/shr-core/tmp-eglibc/sysroots/crespo//usr/share/xcb/xproto.xml
| 
| Failed to load the xcbgen Python package!
| Make sure that xcb/proto installed it on your Python path.
| If not, you will need to create a .pth file or define $PYTHONPATH
| to extend the path.
| Refer to the README file in xcb/proto for more info.
| 
| Traceback (most recent call last):
|   File "./c_client.py", line 2307, in <module>
|     from xcbgen.state import Module
| ImportError: No module named xcbgen.state
| make[1]: *** [xproto.c] Error 1
| make[1]: Leaving directory `/OE/shr-core/tmp-eglibc/work/armv7a-vfp-neon-oe-linux-gnueabi/libxcb/libxcb-1.8.1-r0/libxcb-1.8.1/src'
| make: *** [all-recursive] Error 1
| ERROR: oe_runmake failed
| ERROR: Function failed: do_compile (see /OE/shr-core/tmp-eglibc/work/armv7a-vfp-neon-oe-linux-gnueabi/libxcb/libxcb-1.8.1-r0/temp/log.do_compile.17687 for further information)
NOTE: package libxcb-1.8.1-r0: task do_compile: Failed
ERROR: Task 2798 (/OE/shr-core/openembedded-core/meta/recipes-graphics/xcb/libxcb_1.8.1.bb, do_compile) failed with exit code '1'
Waiting for 1 running tasks to finish:
0: inputproto-1_2.2-r0 do_populate_sysroot (pid 17723)
NOTE: package inputproto-1_2.2-r0: task do_populate_sysroot: Succeeded
NOTE: Tasks Summary: Attempted 2315 tasks of which 1252 didn't need to be rerun and 1 failed.
ERROR: An uncaught exception occured in runqueue, please see the failure below:

Summary: 1 task failed:
  /OE/shr-core/openembedded-core/meta/recipes-graphics/xcb/libxcb_1.8.1.bb, do_compile
Summary: There were 4 WARNING messages shown.
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 205 bytes --]

Re: [oe-commits] Morgan Little : python: Update for python-native changes

[Richard Purdie]

On Sun, 2012-07-29 at 14:50 +0200, Martin Jansa wrote:
> On Mon, Jul 23, 2012 at 01:18:29PM +0200, Martin Jansa wrote:
> > On Sun, Jul 22, 2012 at 10:43:53AM +0000, git@git.openembedded.org wrote:
> > > Module: openembedded-core.git
> > > Branch: master
> > > Commit: 284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > URL:    http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=284a65d55f0ffad0f4f7f32d72da0f9410578643
> > > 
> > > Author: Morgan Little <morgan.little@windriver.com>
> > > Date:   Thu Jul 19 13:46:07 2012 -0400
> > > 
> > > python: Update for python-native changes
> > > 
> > > Add pythonnative onto the list of inherits and update the paths to the binaries
> > > referenced in the recipe to the new paths.
> > > 
> > > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > 
> > 
> > Any idea why is opkg package-index now failing _sometimes_ ?
> > 
> > | + '[' -e /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/ ']'
> > | + touch /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages
> > | + flock /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages.flock -c 'opkg-make-index -r /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -p /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/Packages -m /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/deploy/ipk/'
> > | Traceback (most recent call last):
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 569, in <module>
> > |     main()
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 552, in main
> > |     known_paths = addsitepackages(known_paths)
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 329, in addsitepackages
> > |     for sitedir in getsitepackages():
> > |   File "/var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/sysroots/x86_64-linux/usr/lib/python2.7/site.py", line 303, in getsitepackages
> > |     sitepackages.append(os.path.join(prefix, sys.lib,
> > | AttributeError: 'module' object has no attribute 'lib'
> > | ERROR: Function failed: do_package_index (see /var/lib/jenkins/jobs/shr-core/workspace/shr-core/tmp-eglibc/work/armv4t-oe-linux-gnueabi/package-index-1.0-r0/temp/log.do_package_index.17223 for further information)
> > NOTE: package package-index-1.0-r0: task do_package_index: Failed
> 
> similar issue when building libxcb (http://pastie.org/4352949), works after applying
> 
> http://patchwork.openembedded.org/patch/31987/
> http://patchwork.openembedded.org/patch/31977/

I've merged the latter. The former is incorrect and we need to fix up
the paths in the python module. I'll try and look at it tomorrow if
nobody beats me to it.

Cheers,

Richard