Problem using Subversion in Pyro

Problem using Subversion in Pyro

[Alan Levy]

[-- Attachment #1.1: Type: text/plain, Size: 2802 bytes --]

If I run the following script under Pyro:


DESCRIPTION = "Recipe to test SVN"

PACKAGE_ARCH = "${MACHINE_ARCH}"

LICENSE = "CLOSED"

PV = "${SRCPV}"

SRCREV = "${AUTOREV}"

SRC_URI = "svn://server/path;module=my_module"

I get the following error message (names have been changed...)


ERROR: ExpansionError during parsing <path>/my-recipe.bb                       | ETA:  0:00:01

Traceback (most recent call last):

bb.data_smart.ExpansionError: Failure expanding variable SRCPV, expression was ${@bb.fetch2.get_srcrev(d)}<mailto:$%7b@bb.fetch2.get_srcrev(d)%7d> which triggered exception FetchError: Fetcher failure: Fetch command export DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-ykmscGFFM1"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export PATH="/home/user/project/yocto/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/user/project/yocto/poky/scripts:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/bin/arm-poky-linux-gnueabi:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot/usr/bin/crossscripts:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/sbin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/bin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/sbin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/bin:/home/user/project/yocto/poky/bitbake/bin:/home/user/project/yocto/build/tmp/hosttools"; export HOME="/home/user"; LANG=C LC_ALL=C /usr/bin/env svn --non-interactive --trust-server-cert log --limit 1 --no-auth-cache ! http://server/path/my_module/ failed with exit code 127, output:

/usr/bin/env: 'svn': No such file or directory

If I comment out the line containing SRCPV, all is well. Digging into the code it appears that svn is missing from ${HOSTTOOLS} in bitbake.conf.
ALAN LEVY
Lead Consultant, Embedded Systems

Tel > +44 (0) 1799 533200
Email > alan.levy@plextek.com

[http://www.plextek.com/wp-content/uploads/Footer-AlanLevy.jpg]<http://www.plextek.com/technicalpaper/an-introduction-to-yocto/>
[http://www.plextek.com/wp-content/uploads/2016/04/Plextek-LOGO-for-email.jpg]<http://www.plextek.com/>

www.plextek.com<http://www.plextek.com/>
The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK

Plextek is the trading name of Plextek Services Ltd. Registered in England and Wales, no. 09826669



[-- Attachment #1.2: Type: text/html, Size: 9545 bytes --]

[-- Attachment #2: image001.jpg --]
[-- Type: image/jpeg, Size: 29779 bytes --]

[-- Attachment #3: image002.jpg --]
[-- Type: image/jpeg, Size: 8414 bytes --]

Re: Problem using Subversion in Pyro

[Richard Purdie]

On Thu, 2017-05-18 at 14:22 +0000, Alan Levy wrote:
> --limit 1 --no-auth-cache ! http://server/path/my_module/ failed with
> exit code 127, output:
> /usr/bin/env: 'svn': No such file or directory
>  
> If I comment out the line containing SRCPV, all is well. Digging into
> the code it appears that svn is missing from ${HOSTTOOLS} in
> bitbake.conf.

I can understand how we end up in this situation.

In general, subversion-native is built before the recipe's do_fetch so
things work.

When you use SRCREV = "${AUTOREV}", it needs subversion at parse time
and its obviously not built it. You therefore need to use the host
version. You can enable that with:

HOSTTOOLS_append = " svn"

in your config. I'm not sure I see any way around that. We don't really
want to require subversion in general, its only needed if you're using
autorev svn recipes.

Obviously we could do with improving the failure messages though...

Cheers,

Richard

Re: Problem using Subversion in Pyro

[Alan Levy]

Richard,

I can see that you don't want to force the host system to support subversion and I concur that the resulting error message is unhelpful.

However under Morty this worked just fine so Pyro breaks existing recipes in a way that's very hard to understand, even if the solution is easy once you know how.  I would suggest that as well as providing a helpful error message the documentation should also explain what's going on and how to fix it.

Regards

Alan

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com




-----Original Message-----
From: Richard Purdie [mailto:richard.purdie@linuxfoundation.org] 
Sent: 19 May 2017 10:49
To: Alan Levy; bitbake-devel@lists.openembedded.org
Subject: Re: [bitbake-devel] Problem using Subversion in Pyro

On Thu, 2017-05-18 at 14:22 +0000, Alan Levy wrote:
> --limit 1 --no-auth-cache ! http://server/path/my_module/ failed with 
> exit code 127, output:
> /usr/bin/env: 'svn': No such file or directory
>  
> If I comment out the line containing SRCPV, all is well. Digging into 
> the code it appears that svn is missing from ${HOSTTOOLS} in 
> bitbake.conf.

I can understand how we end up in this situation.

In general, subversion-native is built before the recipe's do_fetch so things work.

When you use SRCREV = "${AUTOREV}", it needs subversion at parse time and its obviously not built it. You therefore need to use the host version. You can enable that with:

HOSTTOOLS_append = " svn"

in your config. I'm not sure I see any way around that. We don't really want to require subversion in general, its only needed if you're using autorev svn recipes.

Obviously we could do with improving the failure messages though...

Cheers,

Richard

Re: Problem using Subversion in Pyro

[Alexander Kanavin]

On 05/19/2017 12:57 PM, Alan Levy wrote:

> I can see that you don't want to force the host system to support
> subversion and I concur that the resulting error message is
> unhelpful.
>
> However under Morty this worked just fine so Pyro breaks existing
> recipes in a way that's very hard to understand, even if the solution
> is easy once you know how.  I would suggest that as well as providing
> a helpful error message the documentation should also explain what's
> going on and how to fix it.

Alan, may I suggest that you write the necessary patches for this and 
send them in?

Thanks,
Alex

Re: Problem using Subversion in Pyro

[Alan Levy]

OK, I have an idea how to do it cleanly and elegantly without breaking the existing scheme but it'll take time I haven't got right now so it may be a while.

Alan

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com




-----Original Message-----
From: Alexander Kanavin [mailto:alexander.kanavin@linux.intel.com] 
Sent: 19 May 2017 11:10
To: Alan Levy; Richard Purdie; bitbake-devel@lists.openembedded.org
Subject: Re: [bitbake-devel] Problem using Subversion in Pyro

On 05/19/2017 12:57 PM, Alan Levy wrote:

> I can see that you don't want to force the host system to support 
> subversion and I concur that the resulting error message is unhelpful.
>
> However under Morty this worked just fine so Pyro breaks existing 
> recipes in a way that's very hard to understand, even if the solution 
> is easy once you know how.  I would suggest that as well as providing 
> a helpful error message the documentation should also explain what's 
> going on and how to fix it.

Alan, may I suggest that you write the necessary patches for this and send them in?

Thanks,
Alex

Problem using Subversion in Pyro

[Alan Levy]

[-- Attachment #1.1: Type: text/plain, Size: 1158 bytes --]

I have a recipe that fetches code from an SVN repository and uses ${SRCPV} to obtain its version number. This works fine under Morty but the recipe crashes out with an error under Pyro because it can't find the SVN executable.

Eventually I traced this down to the fact that SVN is missing from the list of host apps defined in HOSTTOOLS in bitbake.conf. If I add an assignment in local.conf to append svn to HOSTTOOLS all is well again.

I think that this is almost certainly a bug but I thought I'd raise the question here just in case it's really me doing something wrong.
ALAN LEVY
Lead Consultant, Embedded Systems

Tel > +44 (0) 1799 533200
Email > alan.levy@plextek.com

[http://www.plextek.com/wp-content/uploads/Footer-AlanLevy.jpg]<http://www.plextek.com/technicalpaper/an-introduction-to-yocto/>
[http://www.plextek.com/wp-content/uploads/2016/04/Plextek-LOGO-for-email.jpg]<http://www.plextek.com/>

www.plextek.com<http://www.plextek.com/>
The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK

Plextek is the trading name of Plextek Services Ltd. Registered in England and Wales, no. 09826669



[-- Attachment #1.2: Type: text/html, Size: 6713 bytes --]

[-- Attachment #2: image001.jpg --]
[-- Type: image/jpeg, Size: 29779 bytes --]

[-- Attachment #3: image002.jpg --]
[-- Type: image/jpeg, Size: 8414 bytes --]

Re: Problem using Subversion in Pyro

[Alexander Kanavin]

On 05/18/2017 02:40 PM, Alan Levy wrote:
> I have a recipe that fetches code from an SVN repository and uses
> ${SRCPV} to obtain its version number. This works fine under Morty but
> the recipe crashes out with an error under Pyro because it can’t find
> the SVN executable.
>
>
>
> Eventually I traced this down to the fact that SVN is missing from the
> list of host apps defined in HOSTTOOLS in bitbake.conf. If I add an
> assignment in local.conf to append svn to HOSTTOOLS all is well again.
>
>
>
> I think that this is almost certainly a bug but I thought I’d raise the
> question here just in case it’s really me doing something wrong.

There is a subversion recipe in oe-core, and it should be built (in the 
native variant) specifically for this purpose (base.bbclass):

         # Svn packages should DEPEND on subversion-native
         if scheme == "svn":
             needsrcrev = True
             d.appendVarFlag('do_fetch', 'depends', ' 
subversion-native:do_populate_sysroot')

BUT... we no longer have recipes in oe-core that fetch from svn:// so it 
does not get tested, and may well have regressed.

Can you check if it does get build, and whether the subversion binary 
gets installed into your recipe's sysroot?

Alex

Re: Problem using Subversion in Pyro

[Alan Levy]

It does get built, and it apparently does get used to do the actual fetching, just not for miscellaneous functions such as populating SRCREV which rely on the svn executable being on the PATH. This appears to be deliberate since there is a FETCHCMD_svn variable in bitbake.conf. The simplest way for me to force an svn executable onto PATH was to add it to HOSTTOOLS but that may not be what is really intended.

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com





-----Original Message-----
From: Alexander Kanavin [mailto:alexander.kanavin@linux.intel.com] 
Sent: 18 May 2017 13:41
To: yocto@yoctoproject.org; Alan Levy
Subject: Re: [yocto] Problem using Subversion in Pyro

On 05/18/2017 02:40 PM, Alan Levy wrote:
> I have a recipe that fetches code from an SVN repository and uses 
> ${SRCPV} to obtain its version number. This works fine under Morty but 
> the recipe crashes out with an error under Pyro because it can't find 
> the SVN executable.
>
>
>
> Eventually I traced this down to the fact that SVN is missing from the 
> list of host apps defined in HOSTTOOLS in bitbake.conf. If I add an 
> assignment in local.conf to append svn to HOSTTOOLS all is well again.
>
>
>
> I think that this is almost certainly a bug but I thought I'd raise 
> the question here just in case it's really me doing something wrong.

There is a subversion recipe in oe-core, and it should be built (in the native variant) specifically for this purpose (base.bbclass):

         # Svn packages should DEPEND on subversion-native
         if scheme == "svn":
             needsrcrev = True
             d.appendVarFlag('do_fetch', 'depends', ' 
subversion-native:do_populate_sysroot')

BUT... we no longer have recipes in oe-core that fetch from svn:// so it does not get tested, and may well have regressed.

Can you check if it does get build, and whether the subversion binary gets installed into your recipe's sysroot?

Alex

Re: Problem using Subversion in Pyro

[Alexander Kanavin]

On 05/18/2017 04:04 PM, Alan Levy wrote:
> It does get built, and it apparently does get used to do the actual
> fetching, just not for miscellaneous functions such as populating
> SRCREV which rely on the svn executable being on the PATH. This
> appears to be deliberate since there is a FETCHCMD_svn variable in
> bitbake.conf. The simplest way for me to force an svn executable onto
> PATH was to add it to HOSTTOOLS but that may not be what is really
> intended.

SRCREV is supposed to be hardcoded in the recipe. What is the reason you 
need to use svn to set it? Can you show how it's specifically done in 
your recipe?


Alex

Re: Problem using Subversion in Pyro

[Alan Levy]

I want to assign SRCREV to PV, which is perfectly legitimate, so that I can capture the SVN revision number used to build the code. Here's a simple recipe which exhibits the problem:

DESCRIPTION = "Recipe to test SVN"
PACKAGE_ARCH = "${MACHINE_ARCH}"
LICENSE = "CLOSED"
PV = "${SRCPV}"
SRCREV = "${AUTOREV}"
SRC_URI = "svn://server/path;module=my_module"

If you comment out the line referring to SRCPV all is well, if you include it bitbake blows up, even if I just perform cleansstate.

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com





-----Original Message-----
From: Alexander Kanavin [mailto:alexander.kanavin@linux.intel.com] 
Sent: 18 May 2017 14:14
To: Alan Levy; yocto@yoctoproject.org
Subject: Re: [yocto] Problem using Subversion in Pyro

On 05/18/2017 04:04 PM, Alan Levy wrote:
> It does get built, and it apparently does get used to do the actual 
> fetching, just not for miscellaneous functions such as populating 
> SRCREV which rely on the svn executable being on the PATH. This 
> appears to be deliberate since there is a FETCHCMD_svn variable in 
> bitbake.conf. The simplest way for me to force an svn executable onto 
> PATH was to add it to HOSTTOOLS but that may not be what is really 
> intended.

SRCREV is supposed to be hardcoded in the recipe. What is the reason you need to use svn to set it? Can you show how it's specifically done in your recipe?


Alex

Re: Problem using Subversion in Pyro

[Alan Levy]

Just noticed the typo on my part - it's SRCPV that causes the problem, not SRCREV. Apologies for the confusion; a maze of twisty little variables, all alike

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com

-----Original Message-----
From: Alan Levy 
Sent: 18 May 2017 14:32
To: 'Alexander Kanavin'; yocto@yoctoproject.org
Subject: RE: [yocto] Problem using Subversion in Pyro

I want to assign SRCREV to PV, which is perfectly legitimate, so that I can capture the SVN revision number used to build the code. Here's a simple recipe which exhibits the problem:

DESCRIPTION = "Recipe to test SVN"
PACKAGE_ARCH = "${MACHINE_ARCH}"
LICENSE = "CLOSED"
PV = "${SRCPV}"
SRCREV = "${AUTOREV}"
SRC_URI = "svn://server/path;module=my_module"

If you comment out the line referring to SRCPV all is well, if you include it bitbake blows up, even if I just perform cleansstate.

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com





-----Original Message-----
From: Alexander Kanavin [mailto:alexander.kanavin@linux.intel.com]
Sent: 18 May 2017 14:14
To: Alan Levy; yocto@yoctoproject.org
Subject: Re: [yocto] Problem using Subversion in Pyro

On 05/18/2017 04:04 PM, Alan Levy wrote:
> It does get built, and it apparently does get used to do the actual 
> fetching, just not for miscellaneous functions such as populating 
> SRCREV which rely on the svn executable being on the PATH. This 
> appears to be deliberate since there is a FETCHCMD_svn variable in 
> bitbake.conf. The simplest way for me to force an svn executable onto 
> PATH was to add it to HOSTTOOLS but that may not be what is really 
> intended.

SRCREV is supposed to be hardcoded in the recipe. What is the reason you need to use svn to set it? Can you show how it's specifically done in your recipe?


Alex

Re: Problem using Subversion in Pyro

[Alexander Kanavin]

On 05/18/2017 04:46 PM, Alan Levy wrote:
> Just noticed the typo on my part - it's SRCPV that causes the problem, not SRCREV. Apologies for the confusion; a maze of twisty little variables, all alike

So how does it blow up? Can I see the python traceback?

You can also write a minimal recipe with a public svn repo; I can try to 
help, but I'd like you to provide a reproducible example :)

Alex

Re: Problem using Subversion in Pyro

[Alan Levy]

Here it is, certain names have been changed to protect the guilty. As you can see at the bottom svn isn't on the path, so bitbake blows up when it tries to evaluate SRCPV:

ERROR: ExpansionError during parsing <path>/my_recipe.bb                       | ETA:  0:00:01
Traceback (most recent call last):
bb.data_smart.ExpansionError: Failure expanding variable SRCPV, expression was ${@bb.fetch2.get_srcrev(d)} which triggered exception FetchError: Fetcher failure: Fetch command export DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-ykmscGFFM1"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export PATH="/home/user/project/yocto/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/user/project/yocto/poky/scripts:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/bin/arm-poky-linux-gnueabi:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot/usr/bin/crossscripts:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/sbin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/bin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/sbin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/bin:/home/user/project/yocto/poky/bitbake/bin:/home/user/project/yocto/build/tmp/hosttools"; export HOME="/home/user"; LANG=C LC_ALL=C /usr/bin/env svn --non-interactive --trust-server-cert log --limit 1 --no-auth-cache ! http://server/path/my_module/ failed with exit code 127, output:
/usr/bin/env: 'svn': No such file or directory

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com





-----Original Message-----
From: Alexander Kanavin [mailto:alexander.kanavin@linux.intel.com] 
Sent: 18 May 2017 14:48
To: Alan Levy; yocto@yoctoproject.org
Subject: Re: [yocto] Problem using Subversion in Pyro

On 05/18/2017 04:46 PM, Alan Levy wrote:
> Just noticed the typo on my part - it's SRCPV that causes the problem, 
> not SRCREV. Apologies for the confusion; a maze of twisty little 
> variables, all alike

So how does it blow up? Can I see the python traceback?

You can also write a minimal recipe with a public svn repo; I can try to help, but I'd like you to provide a reproducible example :)

Alex

Re: Problem using Subversion in Pyro

[Alexander Kanavin]

On 05/18/2017 05:02 PM, Alan Levy wrote:
> Here it is, certain names have been changed to protect the guilty. As
> you can see at the bottom svn isn't on the path, so bitbake blows up
> when it tries to evaluate SRCPV:
>
> ERROR: ExpansionError during parsing <path>/my_recipe.bb
> | ETA:  0:00:01 Traceback (most recent call last):
> bb.data_smart.ExpansionError: Failure expanding variable SRCPV,
> expression was ${@bb.fetch2.get_srcrev(d)} which triggered exception
> FetchError: Fetcher failure: Fetch command export
> DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-ykmscGFFM1"; export
> SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export
> PATH="/home/user/project/yocto/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/user/project/yocto/poky/scripts:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/bin/arm-poky-linux-gnueabi:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot/usr/bin/crossscripts:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/sbin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/bin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/sbin:/home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/bin:/home/user/project/yocto/poky/bitbake/bin:/home/user/project/yocto/build/tmp/hosttools";
> export HOME="/home/user"; LANG=C LC_ALL=C /usr/bin/env svn
> --non-interactive --trust-server-cert log --limit 1 --no-auth-cache !
> http://server/path/my_module/ failed with exit code 127, output:
> /usr/bin/env: 'svn': No such file or directory
>

Right. This seems to happen way before the fetch task and so does 
require host svn, I guess you'll need to take it to bitbake mailing 
list. It works for git because we are using host's git for the same purpose.

Alex

Re: Problem using Subversion in Pyro

[Alan Levy]

OK, done that now. Thanks for your assistance

Alan

ALAN LEVY, Lead Consultant, Embedded Systems

Plextek Consulting, The Plextek Building, London Road, Great Chesterford, Saffron Walden, CB10 1NY, UK
T: +44 (0) 1799 533200    E: alan.levy@plextek.com  W: www.plextek.com





-----Original Message-----
From: Alexander Kanavin [mailto:alexander.kanavin@linux.intel.com] 
Sent: 18 May 2017 15:12
To: Alan Levy; yocto@yoctoproject.org
Subject: Re: [yocto] Problem using Subversion in Pyro

On 05/18/2017 05:02 PM, Alan Levy wrote:
> Here it is, certain names have been changed to protect the guilty. As 
> you can see at the bottom svn isn't on the path, so bitbake blows up 
> when it tries to evaluate SRCPV:
>
> ERROR: ExpansionError during parsing <path>/my_recipe.bb
> | ETA:  0:00:01 Traceback (most recent call last):
> bb.data_smart.ExpansionError: Failure expanding variable SRCPV, 
> expression was ${@bb.fetch2.get_srcrev(d)} which triggered exception
> FetchError: Fetcher failure: Fetch command export 
> DBUS_SESSION_BUS_ADDRESS="unix:abstract=/tmp/dbus-ykmscGFFM1"; export 
> SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export 
> PATH="/home/user/project/yocto/build/tmp/sysroots-uninative/x86_64-lin
> ux/usr/bin:/home/user/project/yocto/poky/scripts:/home/user/project/yo
> cto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/fetchera
> voidrecurse-r0/recipe-sysroot-native/usr/bin/arm-poky-linux-gnueabi:/h
> ome/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi
> /my-recipe/fetcheravoidrecurse-r0/recipe-sysroot/usr/bin/crossscripts:
> /home/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnuea
> bi/my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/sbin:/ho
> me/user/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/
> my-recipe/fetcheravoidrecurse-r0/recipe-sysroot-native/usr/bin:/home/u
> ser/project/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-r
> ecipe/fetcheravoidrecurse-r0/recipe-sysroot-native/sbin:/home/user/pro
> ject/yocto/build/tmp/work/picozed_zynq7-poky-linux-gnueabi/my-recipe/f
> etcheravoidrecurse-r0/recipe-sysroot-native/bin:/home/user/project/yoc
> to/poky/bitbake/bin:/home/user/project/yocto/build/tmp/hosttools";
> export HOME="/home/user"; LANG=C LC_ALL=C /usr/bin/env svn 
> --non-interactive --trust-server-cert log --limit 1 --no-auth-cache !
> http://server/path/my_module/ failed with exit code 127, output:
> /usr/bin/env: 'svn': No such file or directory
>

Right. This seems to happen way before the fetch task and so does require host svn, I guess you'll need to take it to bitbake mailing list. It works for git because we are using host's git for the same purpose.

Alex

Re: Problem using Subversion in Pyro

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 579 bytes --]

On 18 May 2017 at 12:40, Alan Levy <alan.levy@plextek.com> wrote:

> Eventually I traced this down to the fact that SVN is missing from the
> list of host apps defined in HOSTTOOLS in bitbake.conf. If I add an
> assignment in local.conf to append svn to HOSTTOOLS all is well again.
>
>
As Alex says we typically use subversion-native as we can't rely on the
host subversion being new enough for some features we need.

Does your recipe fetch using svn:// in SRC_URI?  If so then it should have
svn in the sysroot already.  A minimal example would be useful.

Ross

[-- Attachment #2: Type: text/html, Size: 1051 bytes --]