Manipulating code and Building in offline environment

Manipulating code and Building in offline environment

[Lars Larsen]

[-- Attachment #1: Type: text/plain, Size: 1317 bytes --]

Hello

I have 2 questions

I have finally managed to build an image like I want it.


I consists of a kernel.

The ROS framework.

And our proprietary software under git control


What I want to achieve is the following:

When online it should fetch the latest commit (or what ever branch/tag) 
from our git repo.

It should be possible to take a laptop with a fresh checkout of all the 
software, go to the field where the is NO INTERNET access, and be able 
to patch our code on the spot ,and build fresh images, for the target.

When online in our office environment all our own software is correctly 
checked out from our git repo. and build. Beautifully.....

But when offline ( I disconnect the LAN ) I continually gets errors like 
“Failure expanding variable SRCPV” on our software modules.

I have following in build/conf/local.conf


BB_GENERATE_MIRROR_TARBALLS = "1"

INHERIT += "own-mirrors"

SOURCE_MIRROR_URL = "file://${DL_DIR}"


and I experimented with BB_FETCH_PREMIRRORONLY = "1"

with no appearent effect


So question 1:

How do I achieve the offline building. ?

Is should be possible - right ?


Question 2:

Where in the tree is the checked out source code located, that bitbake 
compiles from.



Kind regards

Lars Larsen



[-- Attachment #2: Type: text/html, Size: 3814 bytes --]

Re: Manipulating code and Building in offline environment

[Gary Thomas]

On 2016-04-27 13:38, Lars Larsen wrote:
> Hello
>
> I have 2 questions
>
> I have finally managed to build an image like I want it.
>
>
> I consists of a kernel.
>
> The ROS framework.
>
> And our proprietary software under git control
>
>
> What I want to achieve is the following:
>
> When online it should fetch the latest commit (or what ever branch/tag) from our git repo.
>
> It should be possible to take a laptop with a fresh checkout of all the software, go to the field where the is NO
> INTERNET access, and be able to patch our code on the spot ,and build fresh images, for the target.
>
> When online in our office environment all our own software is correctly checked out from our git repo. and build.
> Beautifully.....
>
> But when offline ( I disconnect the LAN ) I continually gets errors like “Failure expanding variable SRCPV” on our
> software modules.
>
> I have following in build/conf/local.conf
>
>
> BB_GENERATE_MIRROR_TARBALLS = "1"
>
> INHERIT += "own-mirrors"
>
> SOURCE_MIRROR_URL = "file://${DL_DIR}"
>
>
> and I experimented with BB_FETCH_PREMIRRORONLY = "1"
>
> with no appearent effect
>
>
> So question 1:
>
> How do I achieve the offline building. ?
>
> Is should be possible - right ?
>
>
> Question 2:
>
> Where in the tree is the checked out source code located, that bitbake compiles from.
>

I do this all the time successfully.

What is your target and what recipe(s) are having issues?

Note setting BB_NO_NETWORK = "1" in local.conf can help diagnose these issues


-- 
------------------------------------------------------------
Gary Thomas                 |  Consulting for the
MLB Associates              |    Embedded world
------------------------------------------------------------

Re: Manipulating code and Building in offline environment

[Lars Larsen]

[-- Attachment #1: Type: text/plain, Size: 3167 bytes --]



On 2016-04-27 14:21, Gary Thomas wrote:
> On 2016-04-27 13:38, Lars Larsen wrote:
>> Hello
>>
>> I have 2 questions
>>
>> I have finally managed to build an image like I want it.
>>
>>
>> I consists of a kernel.
>>
>> The ROS framework.
>>
>> And our proprietary software under git control
>>
>>
>> What I want to achieve is the following:
>>
>> When online it should fetch the latest commit (or what ever 
>> branch/tag) from our git repo.
>>
>> It should be possible to take a laptop with a fresh checkout of all 
>> the software, go to the field where the is NO
>> INTERNET access, and be able to patch our code on the spot ,and build 
>> fresh images, for the target.
>>
>> When online in our office environment all our own software is 
>> correctly checked out from our git repo. and build.
>> Beautifully.....
>>
>> But when offline ( I disconnect the LAN ) I continually gets errors 
>> like “Failure expanding variable SRCPV” on our
>> software modules.
>>
>> I have following in build/conf/local.conf
>>
>>
>> BB_GENERATE_MIRROR_TARBALLS = "1"
>>
>> INHERIT += "own-mirrors"
>>
>> SOURCE_MIRROR_URL = "file://${DL_DIR}"
>>
>>
>> and I experimented with BB_FETCH_PREMIRRORONLY = "1"
>>
>> with no appearent effect
>>
>>
>> So question 1:
>>
>> How do I achieve the offline building. ?
>>
>> Is should be possible - right ?
>>
>>
>> Question 2:
>>
>> Where in the tree is the checked out source code located, that 
>> bitbake compiles from.
>>
>
> I do this all the time successfully.
>
> What is your target and what recipe(s) are having issues?
>
> Note setting BB_NO_NETWORK = "1" in local.conf can help diagnose these 
> issues
>
>

Thanks for the quick response, I will be happy if you can help me solve 
this, since it's the last stone in our shoes before we go all in on yocto.


My target (at this time) is just a plain vanilla X86 platform - i might 
change in the furture.
The recipes that cause troubles, are those who examine my git repos
one example, I have several made from this template ($BRANCH is set by 
envoking scripts):

/DESCRIPTION = "Reflector deamon-  from local GIT"//
//# The initscript reflectord.sh that starts the deamon is installed 
with basic-framwork-files//
//HOMEPAGE = "www.visionweeding.com"//
//LICENSE = "CLOSED"//
//FPE_PATH = "/opt/fpe"//
//BRANCH ?="develop"//
//SRC_URI = 
"git:///eserver/GIT/autodiscover/;branch=${BRANCH};;name=discover " //
//SRCREV_discover= "${AUTOREV}"//
//SRCREV_FORMAT= "discover"//
//PV = "1.0.0+gitr${SRCPV}"//
//S = "${WORKDIR}/git"//
//inherit cmake//
//FILESEXTRAPATHS_prepend := "${THISDIR}/files:"//
//FILES_${PN} += "${FPE_PATH}/bin/reflectord \//
//        ${FPE_PATH}/bin/SearchBeam \//
//  "//
//do_install_append() {//
//
//    bbnote "Branch test BRANCH= ${BRANCH}"//
////
//      install -d ${D}${FPE_PATH}/bin//
////
//    rm  -rf ${FPE_PATH}/bin/.debug/*//
//    install -d ${D}${sysconfdir}/init.d //
//    install -m 0755 ${WORKDIR}/SearchBeam ${D}${FPE_PATH}/bin //
//    install -m 0755 ${WORKDIR}/reflectord ${D}${FPE_PATH}/bin//
////    }//
//

//
/

[-- Attachment #2: Type: text/html, Size: 5225 bytes --]

Re: Manipulating code and Building in offline environment

[Burton, Ross]

[-- Attachment #1: Type: text/plain, Size: 498 bytes --]

On 27 April 2016 at 14:03, Lars Larsen <lars@visionweeding.com> wrote:
>
> BRANCH ?="develop"
> SRC_URI =
 "git:///eserver/GIT/autodiscover/;branch=${BRANCH};;name=discover "
> SRCREV_discover= "${AUTOREV}"
> SRCREV_FORMAT= "discover"

This is likely the problem.

$(AUTOREV) means "go and get the latest revision every build", which is
incompatible with offline builds.  Set the SRCREV to a specific SHA and
then the mirror can contain the SHA that the recipe wants to build.

Ross

[-- Attachment #2: Type: text/html, Size: 810 bytes --]

Re: Manipulating code and Building in offline environment

[Khem Raj]

On Wed, Apr 27, 2016 at 4:38 AM, Lars Larsen <lars@visionweeding.com> wrote:
> Hello
>
> I have 2 questions
>
> I have finally managed to build an image like I want it.
>
>
> I consists of a kernel.
>
> The ROS framework.
>
> And our proprietary software under git control
>
>
> What I want to achieve is the following:
>
> When online it should fetch the latest commit (or what ever branch/tag) from
> our git repo.
>
> It should be possible to take a laptop with a fresh checkout of all the
> software, go to the field where the is NO INTERNET access, and be able to
> patch our code on the spot ,and build fresh images, for the target.
>
> When online in our office environment all our own software is correctly
> checked out from our git repo. and build. Beautifully.....
>
> But when offline ( I disconnect the LAN ) I continually gets errors like
> “Failure expanding variable SRCPV” on our software modules.
>
> I have following in build/conf/local.conf
>
>
> BB_GENERATE_MIRROR_TARBALLS = "1"
>
> INHERIT += "own-mirrors"
>
> SOURCE_MIRROR_URL = "file://${DL_DIR}"
>
>
> and I experimented with BB_FETCH_PREMIRRORONLY = "1"
>
> with no appearent effect
>
>
> So question 1:
>
> How do I achieve the offline building. ?
>
> Is should be possible - right ?

Change your BB_SRCREV_POLICY = "cached" in local.conf
see if that helps.

>
>
> Question 2:
>
> Where in the tree is the checked out source code located, that bitbake
> compiles from.
>
>
>
> Kind regards
>
> Lars Larsen
>
>
>
> --
> _______________________________________________
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto
>

yocto linux syslinux and intramfs

[Lars Larsen]

Hello yocto world

I desperately need some help
It spawns off my yocto build, so I guess (hope) there is a wise guy or 
two,that can give me some pointers
I realize is not 100% yocto related but, lean towards generic Linux - so 
please forgive me.

I want to be able to boot up from flash, using a rw ramdisk that 
'vanish' when I reboot.
I use SYSLINUX to boot the target.

I have a recipe that can build an image, that works fine.
Now I want it convoluted in an intramfs.

my image recipe

mybase.bb:

DESCRIPTION = "A base image that boots and work"

ALL_MY_APPS= " app1 app2 app3" ## all the software i want on target"
IMAGE_INSTALL = "packagegroup-core-boot ${ROOTFS_PKGMANAGE_BOOTSTRAP} \
  ${CORE_IMAGE_EXTRA_INSTALL} ${ALL_MYAPPS}"
inherit core-image


It creates a nice mybase-image-genericxx86..hdd image and  I copy the 
contents to my flash card.
All very nice
it gets booted,with these lines in syslinux.cfg

LABEL boot
KERNEL /vmlinuz
APPEND initrd=/rootfs.img LABEL=boot  root=/dev/ram0



But If I make a new

conf/initramfs.conf:

IMAGE_FSTYPES = "cpio.gz"

INITRAMFS_IMAGE = "mybase"
INITRAMFS_IMAGE_BUNDLE = "1"

and then run the command
bitbake -R conf/initramfs.conf mybase

I as expected get an bzImage-initramfs-genericx86.bin
I presume this file contains the kernel as well as my rootfs as the initrd
But what to put in syslinux.cfg ?
The logical choise seems to be:


LABEL boot
KERNEL /bzImage-initramfs-genericx86.bin
APPEND LABEL=boot root=/dev/ram0

but it doesn't boot at all. Only flicker on the console, seems to be 
invalid code.

Any advice any one ?
BR Lars