release 2010-12: tar error

release 2010-12: tar error

[Frans Meulenbroeks]

Not sure if this is reproducible or a race but when building console-image
for minimal for calamari I got:

ERROR: Function staging_packager failed
NOTE: Task failed: ('function staging_packager failed',
'/home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026')
ERROR: Task 601
(/home/hudson/jobs/FM_TEST/workspace/openembedded/recipes/linux/linux_2.6.30.bb,
do_package_stage) failed with 256
NOTE: oestats: task failed, see
http://tinderbox.openembedded.net/packages/1176040/
ERROR: Logfile of failure stored in:
/home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026
Log data follows:
| tar: .: file changed as we read it

NOTE: package linux-2.6.30-r6: task do_package_stage: Failed

Didn't have time to dig into this. Sry.

Frans

Re: release 2010-12: tar error

[Khem Raj]

On Fri, Dec 3, 2010 at 7:36 AM, Frans Meulenbroeks
<fransmeulenbroeks@gmail.com> wrote:
> Not sure if this is reproducible or a race but when building console-image
> for minimal for calamari I got:
>
> ERROR: Function staging_packager failed
> NOTE: Task failed: ('function staging_packager failed',
> '/home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026')
> ERROR: Task 601
> (/home/hudson/jobs/FM_TEST/workspace/openembedded/recipes/linux/linux_2.6.30.bb,
> do_package_stage) failed with 256
> NOTE: oestats: task failed, see
> http://tinderbox.openembedded.net/packages/1176040/
> ERROR: Logfile of failure stored in:
> /home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026
> Log data follows:
> | tar: .: file changed as we read it
>
> NOTE: package linux-2.6.30-r6: task do_package_stage: Failed
>
> Didn't have time to dig into this. Sry.

yes this happens time to time. Its some sort of race condition. I get
it sometimes in different packages but never went in deep to fix it.

>
> Frans
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/openembedded-devel
>

Re: release 2010-12: tar error

[Denys Dmytriyenko]

On Fri, Dec 03, 2010 at 11:44:14AM -0800, Khem Raj wrote:
> On Fri, Dec 3, 2010 at 7:36 AM, Frans Meulenbroeks
> <fransmeulenbroeks@gmail.com> wrote:
> > Not sure if this is reproducible or a race but when building console-image
> > for minimal for calamari I got:
> >
> > ERROR: Function staging_packager failed
> > NOTE: Task failed: ('function staging_packager failed',
> > '/home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026')
> > ERROR: Task 601
> > (/home/hudson/jobs/FM_TEST/workspace/openembedded/recipes/linux/linux_2.6.30.bb,
> > do_package_stage) failed with 256
> > NOTE: oestats: task failed, see
> > http://tinderbox.openembedded.net/packages/1176040/
> > ERROR: Logfile of failure stored in:
> > /home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026
> > Log data follows:
> > | tar: .: file changed as we read it
> >
> > NOTE: package linux-2.6.30-r6: task do_package_stage: Failed
> >
> > Didn't have time to dig into this. Sry.
> 
> yes this happens time to time. Its some sort of race condition. I get
> it sometimes in different packages but never went in deep to fix it.

I can confirm that this is a long standing race condition, presumably in 
packaged staging - there were several attempts at fixing it w/o much success.

-- 
Denys

Re: release 2010-12: tar error

[Martyn Welch]

On 06/12/10 20:47, Denys Dmytriyenko wrote:
> On Fri, Dec 03, 2010 at 11:44:14AM -0800, Khem Raj wrote:
>> On Fri, Dec 3, 2010 at 7:36 AM, Frans Meulenbroeks
>> <fransmeulenbroeks@gmail.com> wrote:
>>> Not sure if this is reproducible or a race but when building console-image
>>> for minimal for calamari I got:
>>>
>>> ERROR: Function staging_packager failed
>>> NOTE: Task failed: ('function staging_packager failed',
>>> '/home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026')
>>> ERROR: Task 601
>>> (/home/hudson/jobs/FM_TEST/workspace/openembedded/recipes/linux/linux_2.6.30.bb,
>>> do_package_stage) failed with 256
>>> NOTE: oestats: task failed, see
>>> http://tinderbox.openembedded.net/packages/1176040/
>>> ERROR: Logfile of failure stored in:
>>> /home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026
>>> Log data follows:
>>> | tar: .: file changed as we read it
>>>
>>> NOTE: package linux-2.6.30-r6: task do_package_stage: Failed
>>>
>>> Didn't have time to dig into this. Sry.
>>
>> yes this happens time to time. Its some sort of race condition. I get
>> it sometimes in different packages but never went in deep to fix it.
> 
> I can confirm that this is a long standing race condition, presumably in 
> packaged staging - there were several attempts at fixing it w/o much success.
> 

I recently repeatedly hit this. I'm in the process of setting up some
automated testing which made this particularly annoying. I had
BB_NUMBER_THREADS and PARALLEL_MAKE setup in my local.conf. I think this is
arises when BB_NUMBER_THREADS is set. I've removed it and taken the hit in
build time instead (preferable in my situation). This seems to have stop it
being an issue, but I need to do quite a few more runs to make sure.

Martyn


-- 
Martyn Welch (Principal Software Engineer) | Registered in England and
GE Intelligent Platforms                   | Wales (3828642) at 100
T +44(0)127322748                          | Barbirolli Square, Manchester,
E martyn.welch@ge.com                      | M2 3AB  VAT:GB 927559189

Re: release 2010-12: tar error

[Graham Gower]

On 21 December 2010 22:20, Martyn Welch <martyn.welch@ge.com> wrote:
> On 06/12/10 20:47, Denys Dmytriyenko wrote:
>> On Fri, Dec 03, 2010 at 11:44:14AM -0800, Khem Raj wrote:
>>> On Fri, Dec 3, 2010 at 7:36 AM, Frans Meulenbroeks
>>> <fransmeulenbroeks@gmail.com> wrote:
>>>> Not sure if this is reproducible or a race but when building console-image
>>>> for minimal for calamari I got:
>>>>
>>>> ERROR: Function staging_packager failed
>>>> NOTE: Task failed: ('function staging_packager failed',
>>>> '/home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026')
>>>> ERROR: Task 601
>>>> (/home/hudson/jobs/FM_TEST/workspace/openembedded/recipes/linux/linux_2.6.30.bb,
>>>> do_package_stage) failed with 256
>>>> NOTE: oestats: task failed, see
>>>> http://tinderbox.openembedded.net/packages/1176040/
>>>> ERROR: Logfile of failure stored in:
>>>> /home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026
>>>> Log data follows:
>>>> | tar: .: file changed as we read it
>>>>
>>>> NOTE: package linux-2.6.30-r6: task do_package_stage: Failed
>>>>
>>>> Didn't have time to dig into this. Sry.
>>>
>>> yes this happens time to time. Its some sort of race condition. I get
>>> it sometimes in different packages but never went in deep to fix it.
>>
>> I can confirm that this is a long standing race condition, presumably in
>> packaged staging - there were several attempts at fixing it w/o much success.
>>
>
> I recently repeatedly hit this. I'm in the process of setting up some
> automated testing which made this particularly annoying. I had
> BB_NUMBER_THREADS and PARALLEL_MAKE setup in my local.conf. I think this is
> arises when BB_NUMBER_THREADS is set. I've removed it and taken the hit in
> build time instead (preferable in my situation). This seems to have stop it
> being an issue, but I need to do quite a few more runs to make sure.
>
> Martyn
>

If you have a good way to reproduce any race, please provide instructions.

I have PARALLEL_MAKE = "-j 12" and BB_NUMBER_THREADS = "12" in my
local.conf and have never seen this race.

-Graham

Re: release 2010-12: tar error

[Martyn Welch]

On 21/12/10 22:58, Graham Gower wrote:
> On 21 December 2010 22:20, Martyn Welch <martyn.welch@ge.com> wrote:
>> On 06/12/10 20:47, Denys Dmytriyenko wrote:
>>> On Fri, Dec 03, 2010 at 11:44:14AM -0800, Khem Raj wrote:
>>>> On Fri, Dec 3, 2010 at 7:36 AM, Frans Meulenbroeks
>>>> <fransmeulenbroeks@gmail.com> wrote:
>>>>> Not sure if this is reproducible or a race but when building console-image
>>>>> for minimal for calamari I got:
>>>>>
>>>>> ERROR: Function staging_packager failed
>>>>> NOTE: Task failed: ('function staging_packager failed',
>>>>> '/home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026')
>>>>> ERROR: Task 601
>>>>> (/home/hudson/jobs/FM_TEST/workspace/openembedded/recipes/linux/linux_2.6.30.bb,
>>>>> do_package_stage) failed with 256
>>>>> NOTE: oestats: task failed, see
>>>>> http://tinderbox.openembedded.net/packages/1176040/
>>>>> ERROR: Logfile of failure stored in:
>>>>> /home/hudson/jobs/FM_TEST/workspace/tmp/work/calamari-oe-linux-gnuspe/linux-2.6.30-r6/temp/log.staging_packager.27026
>>>>> Log data follows:
>>>>> | tar: .: file changed as we read it
>>>>>
>>>>> NOTE: package linux-2.6.30-r6: task do_package_stage: Failed
>>>>>
>>>>> Didn't have time to dig into this. Sry.
>>>>
>>>> yes this happens time to time. Its some sort of race condition. I get
>>>> it sometimes in different packages but never went in deep to fix it.
>>>
>>> I can confirm that this is a long standing race condition, presumably in
>>> packaged staging - there were several attempts at fixing it w/o much success.
>>>
>>
>> I recently repeatedly hit this. I'm in the process of setting up some
>> automated testing which made this particularly annoying. I had
>> BB_NUMBER_THREADS and PARALLEL_MAKE setup in my local.conf. I think this is
>> arises when BB_NUMBER_THREADS is set. I've removed it and taken the hit in
>> build time instead (preferable in my situation). This seems to have stop it
>> being an issue, but I need to do quite a few more runs to make sure.
>>
>> Martyn
>>
> 
> If you have a good way to reproduce any race, please provide instructions.
> 
> I have PARALLEL_MAKE = "-j 12" and BB_NUMBER_THREADS = "12" in my
> local.conf and have never seen this race.
> 
> -Graham
> 

I really wish I could say I had. I believe I have had PARALLEL_MAKE = "-j 2"
and BB_NUMBER_THREADS = "2" in my configuration for quite a while now and
didn't see this problem until I started to script some of our testing.

Martyn

-- 
Martyn Welch (Principal Software Engineer) | Registered in England and
GE Intelligent Platforms                   | Wales (3828642) at 100
T +44(0)127322748                          | Barbirolli Square, Manchester,
E martyn.welch@ge.com                      | M2 3AB  VAT:GB 927559189