[Question]Does poky rebuild source when only makefile was modified

[Question]Does poky rebuild source when only makefile was modified

[biannm]

Hi,

 Usually, if only makefile is modified, "make" will not rebuild source.
 Does poky rebuild source in the following case.

 1. build a recipe
 2. modify the bb file of this recipe, which will cause only makefile to be modified.
    Ex. set a new path to libdir
 3. rebuild this recipe without doing cleansstate before


Regards
 Bian

Re: [Question]Does poky rebuild source when only makefile was modified

[Richard Purdie]

On Mon, 2014-08-04 at 10:01 +0000, biannm@cn.fujitsu.com wrote:
> Hi,
> 
>  Usually, if only makefile is modified, "make" will not rebuild source.
>  Does poky rebuild source in the following case.
> 
>  1. build a recipe
>  2. modify the bb file of this recipe, which will cause only makefile to be modified.
>     Ex. set a new path to libdir
>  3. rebuild this recipe without doing cleansstate before

This change to libdir would change the checksum of the configure task
and the configure task would execute. Assuming this is an autotools
recipe (where B != S is supported), it would wipe out ${B} due to the
change and rebuild everything from the configure step onwards.

Cheers,

Richard

Re: [Question]Does poky rebuild source when only makefile was modified

[biannm]

Thanks for your answer.
I had confirmed that tasks from the configure will be rebuild.
But the timestamp of source files doesn't have any change, 
although do_compile task will be rebuild, the source files will not be rebuild.

When we rebuild our project by make, we always do "make clean" firstly to make sure source files to be rebuild if only makefile have been changed.
Does it means we must do "bitbake xxx -c cleansstate" firstly if we just modify bb file
that changes libdir only.

Regards
 Bian

-----Original Message-----
From: Richard Purdie [mailto:richard.purdie@linuxfoundation.org] 
Sent: Monday, August 04, 2014 6:24 PM
To: Bian, Naimeng
Cc: poky@yoctoproject.org
Subject: Re: [poky] [Question]Does poky rebuild source when only makefile was modified

On Mon, 2014-08-04 at 10:01 +0000, biannm@cn.fujitsu.com wrote:
> Hi,
> 
>  Usually, if only makefile is modified, "make" will not rebuild source.
>  Does poky rebuild source in the following case.
> 
>  1. build a recipe
>  2. modify the bb file of this recipe, which will cause only makefile to be modified.
>     Ex. set a new path to libdir
>  3. rebuild this recipe without doing cleansstate before

This change to libdir would change the checksum of the configure task and the configure task would execute. Assuming this is an autotools recipe (where B != S is supported), it would wipe out ${B} due to the change and rebuild everything from the configure step onwards.

Cheers,

Richard

Re: [Question]Does poky rebuild source when only makefile was modified

[Khem Raj]

On 14-08-05 01:35:32, biannm@cn.fujitsu.com wrote:
> Thanks for your answer.
> I had confirmed that tasks from the configure will be rebuild.
> But the timestamp of source files doesn't have any change, 
> although do_compile task will be rebuild, the source files will not be rebuild.
> 
> When we rebuild our project by make, we always do "make clean" firstly to make sure source files to be rebuild if only makefile have been changed.
> Does it means we must do "bitbake xxx -c cleansstate" firstly if we just modify bb file
> that changes libdir only.

No, bitbake should take care of invalidated the affected tasks and
redoing the tast and dependent task.

Re: [Question]Does poky rebuild source when only makefile was modified

[biannm]

> No, bitbake should take care of invalidated the affected tasks and redoing the tast and dependent task.

Agree.
Any suggestion to fix this problem.

Regards
 Bian

-----Original Message-----
From: Khem Raj [mailto:raj.khem@gmail.com] 
Sent: Tuesday, August 05, 2014 10:25 AM
To: Bian, Naimeng/卞 乃猛
Cc: Richard Purdie; poky@yoctoproject.org
Subject: Re: [poky] [Question]Does poky rebuild source when only makefile was modified

On 14-08-05 01:35:32, biannm@cn.fujitsu.com wrote:
> Thanks for your answer.
> I had confirmed that tasks from the configure will be rebuild.
> But the timestamp of source files doesn't have any change, although 
> do_compile task will be rebuild, the source files will not be rebuild.
> 
> When we rebuild our project by make, we always do "make clean" firstly to make sure source files to be rebuild if only makefile have been changed.
> Does it means we must do "bitbake xxx -c cleansstate" firstly if we 
> just modify bb file that changes libdir only.

No, bitbake should take care of invalidated the affected tasks and redoing the tast and dependent task.

Re: [Question]Does poky rebuild source when only makefile was modified

[Khem Raj]

[-- Attachment #1: Type: text/plain, Size: 1392 bytes --]

On Monday, August 4, 2014, biannm@cn.fujitsu.com <biannm@cn.fujitsu.com>
wrote:

> > No, bitbake should take care of invalidated the affected tasks and
> redoing the tast and dependent task.
>
> Agree.
> Any suggestion to fix this problem.


Is there still a problem ? If yes then explain and we can try to solve it

>
> Regards
>  Bian
>
> -----Original Message-----
> From: Khem Raj [mailto:raj.khem@gmail.com <javascript:;>]
> Sent: Tuesday, August 05, 2014 10:25 AM
> To: Bian, Naimeng/卞 乃猛
> Cc: Richard Purdie; poky@yoctoproject.org <javascript:;>
> Subject: Re: [poky] [Question]Does poky rebuild source when only makefile
> was modified
>
> On 14-08-05 01:35:32, biannm@cn.fujitsu.com <javascript:;> wrote:
> > Thanks for your answer.
> > I had confirmed that tasks from the configure will be rebuild.
> > But the timestamp of source files doesn't have any change, although
> > do_compile task will be rebuild, the source files will not be rebuild.
> >
> > When we rebuild our project by make, we always do "make clean" firstly
> to make sure source files to be rebuild if only makefile have been changed.
> > Does it means we must do "bitbake xxx -c cleansstate" firstly if we
> > just modify bb file that changes libdir only.
>
> No, bitbake should take care of invalidated the affected tasks and redoing
> the tast and dependent task.
>

[-- Attachment #2: Type: text/html, Size: 2077 bytes --]

Re: [Question]Does poky rebuild source when only makefile was modified

[biannm]

If $B != $S is supported, there is not a problem.
When we rebuild a recipe where $B != $S is not supported, although tasks will be redone, 
the source files will not be rebuild if we just change the libdir.

Does you mean that we just make this recipe to support  $B != $S in this case.

Regards
 Bian

-----Original Message-----
From: Khem Raj [mailto:raj.khem@gmail.com] 
Sent: Tuesday, August 05, 2014 1:06 PM
To: Bian, Naimeng
Cc: Richard Purdie; poky@yoctoproject.org
Subject: Re: [poky] [Question]Does poky rebuild source when only makefile was modified


> On Monday, August 4, 2014, biannm@cn.fujitsu.com <biannm@cn.fujitsu.com> wrote:
> >> No, bitbake should take care of invalidated the affected tasks and redoing the tast and dependent task.

> >Agree.
> >Any suggestion to fix this problem.

> Is there still a problem ? If yes then explain and we can try to solve it 

Regards
 Bian

-----Original Message-----
From: Khem Raj [mailto:raj.khem@gmail.com]
Sent: Tuesday, August 05, 2014 10:25 AM
To: Bian, Naimeng
Cc: Richard Purdie; poky@yoctoproject.org
Subject: Re: [poky] [Question]Does poky rebuild source when only makefile was modified

On 14-08-05 01:35:32, biannm@cn.fujitsu.com wrote:
> Thanks for your answer.
> I had confirmed that tasks from the configure will be rebuild.
> But the timestamp of source files doesn't have any change, although
> do_compile task will be rebuild, the source files will not be rebuild.
>
> When we rebuild our project by make, we always do "make clean" firstly to make sure source files to be rebuild if only makefile have been changed.
> Does it means we must do "bitbake xxx -c cleansstate" firstly if we
> just modify bb file that changes libdir only.

No, bitbake should take care of invalidated the affected tasks and redoing the tast and dependent task.

Re: [Question]Does poky rebuild source when only makefile was modified

[Khem Raj]

On Mon, Aug 4, 2014 at 10:57 PM, biannm@cn.fujitsu.com
<biannm@cn.fujitsu.com> wrote:
> When we rebuild a recipe where $B != $S is not supported, although tasks will be redone,
> the source files will not be rebuild if we just change the libdir.

I think tasks should execute and if underlying build system is able to
handle rebuilds in same directory without cleaning it will work out to
be ok
if not then you might have to resort to manual cleaning and rebuilding
of the package

Re: [Question]Does poky rebuild source when only makefile was modified

[Richard Purdie]

On Tue, 2014-08-05 at 05:57 +0000, biannm@cn.fujitsu.com wrote:
> If $B != $S is supported, there is not a problem.
> When we rebuild a recipe where $B != $S is not supported, although tasks will be redone, 
> the source files will not be rebuild if we just change the libdir.

It depends on the Makefiles. Some work well, some don't.

> Does you mean that we just make this recipe to support  $B != $S in this case.

Yes, that would be one way to solve the problem.

Cheers,

Richard

Re: [Question]Does poky rebuild source when only makefile was modified

[biannm]

> On Tue, 2014-08-05 at 05:57 +0000, biannm@cn.fujitsu.com wrote:
> > If $B != $S is supported, there is not a problem.
> > When we rebuild a recipe where $B != $S is not supported, although
> > tasks will be redone, the source files will not be rebuild if we just
> change the libdir.
> 
> It depends on the Makefiles. Some work well, some don't.

Yes, i think so too.
And, does you mean this is not the problem of yocto, we don't need care it?

> 
> > Does you mean that we just make this recipe to support  $B != $S in this
> case.
> 
> Yes, that would be one way to solve the problem.

But how can i divide those recipe from normal one,
it's not easy to understand for yocto developer because the rebuild will not report any message in this case.

Regards
 Bian

Re: [Question]Does poky rebuild source when only makefile was modified

[Richard Purdie]

On Tue, 2014-08-05 at 10:23 +0000, biannm@cn.fujitsu.com wrote:
> > On Tue, 2014-08-05 at 05:57 +0000, biannm@cn.fujitsu.com wrote:
> > > If $B != $S is supported, there is not a problem.
> > > When we rebuild a recipe where $B != $S is not supported, although
> > > tasks will be redone, the source files will not be rebuild if we just
> > change the libdir.
> > 
> > It depends on the Makefiles. Some work well, some don't.
> 
> Yes, i think so too.
> And, does you mean this is not the problem of yocto, we don't need care it?

Well, you could force the build system to wipe out and reconstruct ${S}
any time there was a change. For better or worse we've effectively
decided that its too much overhead for day to day use. If you need that
level of determinism, you can wipe TMPDIR.

> > > Does you mean that we just make this recipe to support  $B != $S in this
> > case.
> > 
> > Yes, that would be one way to solve the problem.
> 
> But how can i divide those recipe from normal one,
> it's not easy to understand for yocto developer because the rebuild will not report any message in this case.

Its a limitation of the software we're building so its not something its
easy for "Yocto" to fix...

Cheers,

Richard

Re: [Question]Does poky rebuild source when only makefile was modified

[biannm]

> -----Original Message-----
> From: Richard Purdie [mailto:richard.purdie@linuxfoundation.org]
> Sent: Tuesday, August 05, 2014 6:49 PM
> On Tue, 2014-08-05 at 10:23 +0000, biannm@cn.fujitsu.com wrote:
> > > On Tue, 2014-08-05 at 05:57 +0000, biannm@cn.fujitsu.com wrote:
> > > > If $B != $S is supported, there is not a problem.
> > > > When we rebuild a recipe where $B != $S is not supported, although
> > > > tasks will be redone, the source files will not be rebuild if we
> > > > just
> > > change the libdir.
> > >
> > > It depends on the Makefiles. Some work well, some don't.
> >
> > Yes, i think so too.
> > And, does you mean this is not the problem of yocto, we don't need care
> it?
> 
> Well, you could force the build system to wipe out and reconstruct ${S}
> any time there was a change. For better or worse we've effectively decided
> that its too much overhead for day to day use. If you need that level of
> determinism, you can wipe TMPDIR.
> 
> > > > Does you mean that we just make this recipe to support  $B != $S
> > > > in this
> > > case.
> > >
> > > Yes, that would be one way to solve the problem.
> >
> > But how can i divide those recipe from normal one, it's not easy to
> > understand for yocto developer because the rebuild will not report any
> message in this case.
> 
> Its a limitation of the software we're building so its not something its
> easy for "Yocto" to fix...
> 

Thanks for your answer.
Sorry for my later. ^_^

Cheers,
 Bian