meta-mono: Issue building 4.0.2.4

meta-mono: Issue building 4.0.2.4

[Chris Morgan]

The double nested output folder looks odd to me but leaving that, it
looks like a file is being installed twice. Anyone else seeing this?

meta
meta-skeleton     =
"(HEADdetachedat16caaab):16caaabfcc678b03a0cd88aaeac15f9b8d1c3dad"
meta-yocto
meta-yocto-bsp    =
"(HEADdetachedat16caaab):16caaabfcc678b03a0cd88aaeac15f9b8d1c3dad"
meta-mono         = "master:35e8ede514dd35eb3d645d5de22282d0e8204f86"
meta-oe
meta-webserver    =
"(HEADdetachedatdf6c7b1):df6c7b1279790d27ebfd58fbdfbac89bde5782ec"
meta-ti           =
"(HEADdetachedatb81014d):b81014dbb5cc39fdfa66af87d18b72eb9eb3c701"
meta-nodejs       =
"(HEADdetachedate724e27):e724e270bc23a14f12d4a0d73869199457a1b925"
bitbake-npm       =
"(HEADdetachedatd88833b):d88833bcf52da7d00e775ca8c2e63ca44cf6ace1"
meta-ros          =
"(HEADdetachedatbdc603b):bdc603b821eae5e1d966ec25e63f6832f6386dc8"
meta-rust         =
"(HEADdetachedat61708ed):61708ed85e76beafdb08b6caf340abeae13bf4b2"
meta-qt5          =
"(HEADdetachedat378dfc2):378dfc20ad0e024412da7f3be22efe04c3421c6d"
meta-ruby
meta-python
meta-networking   =
"(HEADdetachedatdf6c7b1):df6c7b1279790d27ebfd58fbdfbac89bde5782ec"


(output snipped)
| /usr/bin/install -c -c -m 644 frameworks/net_4.5.xml
/home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml
| /usr/bin/install -c -c -m 644
targets/Microsoft.WebApplication.targets
/home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v9.0/WebApplications
| mkdir -p -- /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/14.0/bin/MSBuild
| /usr/bin/install -c -c -m 644
targets/Microsoft.Portable.Common.targets
/home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/Portable/v4.0/Microsoft.Portable.Common.targets
| /usr/bin/install -c -c -m 644
targets/Microsoft.WebApplication.targets
/home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v9.0/WebApplications
| /usr/bin/install: cannot create regular file
'/home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml':
File exists
| Makefile:42: recipe for target 'install-frameworks' failed
| make[6]: *** [install-frameworks] Error 1
| make[6]: *** Waiting for unfinished jobs....

Re: meta-mono: Issue building 4.0.2.4

[Alex J Lennon]

On 24/06/2015 01:01, Chris Morgan wrote:
> The double nested output folder looks odd to me but leaving that, it
> looks like a file is being installed twice. Anyone else seeing this?
>
> meta
> meta-skeleton     =
> "(HEADdetachedat16caaab):16caaabfcc678b03a0cd88aaeac15f9b8d1c3dad"
> meta-yocto
> meta-yocto-bsp    =
> "(HEADdetachedat16caaab):16caaabfcc678b03a0cd88aaeac15f9b8d1c3dad"
> meta-mono         = "master:35e8ede514dd35eb3d645d5de22282d0e8204f86"
> meta-oe
> meta-webserver    =
> "(HEADdetachedatdf6c7b1):df6c7b1279790d27ebfd58fbdfbac89bde5782ec"
> meta-ti           =
> "(HEADdetachedatb81014d):b81014dbb5cc39fdfa66af87d18b72eb9eb3c701"
> meta-nodejs       =
> "(HEADdetachedate724e27):e724e270bc23a14f12d4a0d73869199457a1b925"
> bitbake-npm       =
> "(HEADdetachedatd88833b):d88833bcf52da7d00e775ca8c2e63ca44cf6ace1"
> meta-ros          =
> "(HEADdetachedatbdc603b):bdc603b821eae5e1d966ec25e63f6832f6386dc8"
> meta-rust         =
> "(HEADdetachedat61708ed):61708ed85e76beafdb08b6caf340abeae13bf4b2"
> meta-qt5          =
> "(HEADdetachedat378dfc2):378dfc20ad0e024412da7f3be22efe04c3421c6d"
> meta-ruby
> meta-python
> meta-networking   =
> "(HEADdetachedatdf6c7b1):df6c7b1279790d27ebfd58fbdfbac89bde5782ec"
>
>
> (output snipped)
> | /usr/bin/install -c -c -m 644 frameworks/net_4.5.xml
> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml
> | /usr/bin/install -c -c -m 644
> targets/Microsoft.WebApplication.targets
> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v9.0/WebApplications
> | mkdir -p -- /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/14.0/bin/MSBuild
> | /usr/bin/install -c -c -m 644
> targets/Microsoft.Portable.Common.targets
> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/Portable/v4.0/Microsoft.Portable.Common.targets
> | /usr/bin/install -c -c -m 644
> targets/Microsoft.WebApplication.targets
> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v9.0/WebApplications
> | /usr/bin/install: cannot create regular file
> '/home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml':
> File exists
> | Makefile:42: recipe for target 'install-frameworks' failed
> | make[6]: *** [install-frameworks] Error 1
> | make[6]: *** Waiting for unfinished jobs....

Hi Chris,

Yes the double nesting does look odd.

I did a test build of 4.0.2.4 here which worked for me. I've also been
supporting another chap who wanted to build 4.0.2.4 rather than the
default 3.12.1 build and he also let me know he had it building
successfully

Clearly there's some kind of issue though. I'm relocating between
countries at the moment without access to a build system and so it'll be
1-2 weeks before I can investigate further myself I'm afraid.

In the meantime do 4.0.1.34  and earlier versions build for you? Does -c
cleansstate help?

Regards,

Alex

Re: meta-mono: Issue building 4.0.2.4

[Chris Morgan]

On Wed, Jun 24, 2015 at 9:13 AM, Alex J Lennon
<ajlennon@dynamicdevices.co.uk> wrote:
>
>
> On 24/06/2015 01:01, Chris Morgan wrote:
>> The double nested output folder looks odd to me but leaving that, it
>> looks like a file is being installed twice. Anyone else seeing this?
>>
>> meta
>> meta-skeleton     =
>> "(HEADdetachedat16caaab):16caaabfcc678b03a0cd88aaeac15f9b8d1c3dad"
>> meta-yocto
>> meta-yocto-bsp    =
>> "(HEADdetachedat16caaab):16caaabfcc678b03a0cd88aaeac15f9b8d1c3dad"
>> meta-mono         = "master:35e8ede514dd35eb3d645d5de22282d0e8204f86"
>> meta-oe
>> meta-webserver    =
>> "(HEADdetachedatdf6c7b1):df6c7b1279790d27ebfd58fbdfbac89bde5782ec"
>> meta-ti           =
>> "(HEADdetachedatb81014d):b81014dbb5cc39fdfa66af87d18b72eb9eb3c701"
>> meta-nodejs       =
>> "(HEADdetachedate724e27):e724e270bc23a14f12d4a0d73869199457a1b925"
>> bitbake-npm       =
>> "(HEADdetachedatd88833b):d88833bcf52da7d00e775ca8c2e63ca44cf6ace1"
>> meta-ros          =
>> "(HEADdetachedatbdc603b):bdc603b821eae5e1d966ec25e63f6832f6386dc8"
>> meta-rust         =
>> "(HEADdetachedat61708ed):61708ed85e76beafdb08b6caf340abeae13bf4b2"
>> meta-qt5          =
>> "(HEADdetachedat378dfc2):378dfc20ad0e024412da7f3be22efe04c3421c6d"
>> meta-ruby
>> meta-python
>> meta-networking   =
>> "(HEADdetachedatdf6c7b1):df6c7b1279790d27ebfd58fbdfbac89bde5782ec"
>>
>>
>> (output snipped)
>> | /usr/bin/install -c -c -m 644 frameworks/net_4.5.xml
>> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml
>> | /usr/bin/install -c -c -m 644
>> targets/Microsoft.WebApplication.targets
>> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v9.0/WebApplications
>> | mkdir -p -- /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/14.0/bin/MSBuild
>> | /usr/bin/install -c -c -m 644
>> targets/Microsoft.Portable.Common.targets
>> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/Portable/v4.0/Microsoft.Portable.Common.targets
>> | /usr/bin/install -c -c -m 644
>> targets/Microsoft.WebApplication.targets
>> /home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v9.0/WebApplications
>> | /usr/bin/install: cannot create regular file
>> '/home/cmorgan/projects/yocto/build/tmp/work/x86_64-linux/mono-native/4.0.2.4-r0/image/home/cmorgan/projects/yocto/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml':
>> File exists
>> | Makefile:42: recipe for target 'install-frameworks' failed
>> | make[6]: *** [install-frameworks] Error 1
>> | make[6]: *** Waiting for unfinished jobs....
>
> Hi Chris,
>
> Yes the double nesting does look odd.
>
> I did a test build of 4.0.2.4 here which worked for me. I've also been
> supporting another chap who wanted to build 4.0.2.4 rather than the
> default 3.12.1 build and he also let me know he had it building
> successfully
>
> Clearly there's some kind of issue though. I'm relocating between
> countries at the moment without access to a build system and so it'll be
> 1-2 weeks before I can investigate further myself I'm afraid.
>
> In the meantime do 4.0.1.34  and earlier versions build for you? Does -c
> cleansstate help?
>
> Regards,
>
> Alex
>
>

Tried the cleansstate with 4.0.2.4 before sending the initial email.

Similar issue with 4.0.1.34 but a different file and a different
section of the code:

| /usr/bin/install -c -c -m 644
targets/Microsoft.Portable.Common.targets
/home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/Portable/v4.5/Microsoft.Portable.Common.targets
| /usr/bin/install -c -c -m 644
targets/Microsoft.WebApplication.targets
/home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v11.0/WebApplications
| /usr/bin/install -c -c -m 644
targets/Microsoft.WebApplication.targets
/home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v11.0/WebApplications
| /usr/bin/install: cannot create regular file
'/home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v11.0/WebApplications/Microsoft.WebApplication.targets':
File exists
| Makefile:70: recipe for target 'install-web-targets' failed
| make[6]: *** [install-web-targets] Error 1
| make[6]: *** Waiting for unfinished jobs....


Its as if mono is installing the same files multiple times.


Chris

Re: meta-mono: Issue building 4.0.2.4

[Richard Tollerton]

Chris Morgan <chmorgan@gmail.com> writes:

> /home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v11.0/WebApplications
> | /usr/bin/install: cannot create regular file
> '/home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v11.0/WebApplications/Microsoft.WebApplication.targets':
> File exists

Did you try disabling PARALLEL_MAKE? I found a flat-out race at -j6:

/usr/bin/install: cannot change permissions of
build/tmp-glibc/work/x86_64-linux/mono-native/4.0.2.4-r0/image/build/tmp-glibc/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml: No such file or
directory

... and FrameworkList.xml nevertheless existed once the failed build completed.

Re: meta-mono: Issue building 4.0.2.4

[Chris Morgan]

On Tue, Jul 7, 2015 at 4:01 PM, Richard Tollerton <rich.tollerton@ni.com> wrote:
> Chris Morgan <chmorgan@gmail.com> writes:
>
>> /home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v11.0/WebApplications
>> | /usr/bin/install: cannot create regular file
>> '/home/cmorgan/projects/yocto-cybex/build/tmp/work/x86_64-linux/mono-native/4.0.1.34-r0/image/home/cmorgan/projects/yocto-cybex/build/tmp/sysroots/x86_64-linux/usr/lib/mono/xbuild/Microsoft/VisualStudio/v11.0/WebApplications/Microsoft.WebApplication.targets':
>> File exists
>
> Did you try disabling PARALLEL_MAKE? I found a flat-out race at -j6:
>
> /usr/bin/install: cannot change permissions of
> build/tmp-glibc/work/x86_64-linux/mono-native/4.0.2.4-r0/image/build/tmp-glibc/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/.NETFramework/v4.5/RedistList/FrameworkList.xml: No such file or
> directory
>
> ... and FrameworkList.xml nevertheless existed once the failed build completed.


I haven't tried that. Is that something that would go into the recipe,
if it were necessary? If so, how do you do that?

Chris

[PATCH] mono-4.xx.inc: disable parallel make

[Richard Tollerton]

A race was observed during `make install` of mono-native under
PARALLEL_MAKE=-j6:

/usr/bin/install: cannot change permissions of
build/tmp-glibc/work/x86_64-linux/mono-native/4.0.2.4-r0/image/
build/tmp-glibc/sysroots/x86_64-linux/usr/lib/mono/xbuild-frameworks/
.NETFramework/v4.5/RedistList/FrameworkList.xml: No such file or
directory

This is definitely a race, because FrameworkList.xml was present once
the failed build completed.

The present mono build doesn't appear to build much of anything in
parallel in the first place, and I would guess that this issue applies
equally to the mono and mono-native builds. So the correct place for the
workaround ought to be in the shared .inc file.

Signed-off-by: Richard Tollerton <rich.tollerton@ni.com>
---
 recipes-mono/mono/mono-4.xx.inc | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/recipes-mono/mono/mono-4.xx.inc b/recipes-mono/mono/mono-4.xx.inc
index 2d7f65d..973593a 100644
--- a/recipes-mono/mono/mono-4.xx.inc
+++ b/recipes-mono/mono/mono-4.xx.inc
@@ -68,3 +68,6 @@ FILES_${PN}-dbg 			+= " ${datadir}/mono-2.0/mono/cil/cil-opcodes.xml ${libdir}/m
 FILES_${PN}-staticdev 			+= " ${libdir}/*.a"
 
 RDEPENDS_${PN} =+ "bash" 
+
+# Workaround for observed race in `make install`
+PARALLEL_MAKE=""
-- 
2.4.4

Re: [PATCH] mono-4.xx.inc: disable parallel make

[Alex J Lennon]

On 07/07/2015 21:17, Richard Tollerton wrote:
> A race was observed during `make install` of mono-native under
> PARALLEL_MAKE=-j6:

Thanks Richard - patch applied

Chris - I wasn't able to replicate the failure you see under Fedora F22
with PARALLEL_MAKE="-j 6". The build works for me here.
Can you confirm Richard's patch fixes the issue you see on your system?

Thanks,

Alex

Re: [PATCH] mono-4.xx.inc: disable parallel make

[Chris Morgan]

On Wed, Jul 8, 2015 at 6:49 AM, Alex J Lennon
<ajlennon@dynamicdevices.co.uk> wrote:
>
>
> On 07/07/2015 21:17, Richard Tollerton wrote:
>> A race was observed during `make install` of mono-native under
>> PARALLEL_MAKE=-j6:
>
> Thanks Richard - patch applied
>
> Chris - I wasn't able to replicate the failure you see under Fedora F22
> with PARALLEL_MAKE="-j 6". The build works for me here.
> Can you confirm Richard's patch fixes the issue you see on your system?
>
> Thanks,
>
> Alex
>

Hi Alex.

I can confirm that it fixes the build for me here under F22 on an 8
core machine, although it takes a long time to fail.

Seems like something that should be reported upstream to mono. I
copied them on Richard's email but haven't seen any response yet.

Chris

Re: [PATCH] mono-4.xx.inc: disable parallel make

[Alex J Lennon]

On 08/07/2015 21:07, Chris Morgan wrote:
> On Wed, Jul 8, 2015 at 6:49 AM, Alex J Lennon
> <ajlennon@dynamicdevices.co.uk> wrote:
>>
>> On 07/07/2015 21:17, Richard Tollerton wrote:
>>> A race was observed during `make install` of mono-native under
>>> PARALLEL_MAKE=-j6:
>> Thanks Richard - patch applied
>>
>> Chris - I wasn't able to replicate the failure you see under Fedora F22
>> with PARALLEL_MAKE="-j 6". The build works for me here.
>> Can you confirm Richard's patch fixes the issue you see on your system?
>>
>> Thanks,
>>
>> Alex
>>
> Hi Alex.
>
> I can confirm that it fixes the build for me here under F22 on an 8
> core machine, although it takes a long time to fail.
>
> Seems like something that should be reported upstream to mono. I
> copied them on Richard's email but haven't seen any response yet.
>

Hi Chris,

Thanks for coming back to me, at least we have an interim workaround then.

You might consider putting a bug report up on Xamarin's bugzilla?

http://www.mono-project.com/community/bugs/

Cheers, Alex

Re: [PATCH] mono-4.xx.inc: disable parallel make

[Chris Morgan]

On Thu, Jul 9, 2015 at 4:03 AM, Alex J Lennon
<ajlennon@dynamicdevices.co.uk> wrote:
>
>
> On 08/07/2015 21:07, Chris Morgan wrote:
>> On Wed, Jul 8, 2015 at 6:49 AM, Alex J Lennon
>> <ajlennon@dynamicdevices.co.uk> wrote:
>>>
>>> On 07/07/2015 21:17, Richard Tollerton wrote:
>>>> A race was observed during `make install` of mono-native under
>>>> PARALLEL_MAKE=-j6:
>>> Thanks Richard - patch applied
>>>
>>> Chris - I wasn't able to replicate the failure you see under Fedora F22
>>> with PARALLEL_MAKE="-j 6". The build works for me here.
>>> Can you confirm Richard's patch fixes the issue you see on your system?
>>>
>>> Thanks,
>>>
>>> Alex
>>>
>> Hi Alex.
>>
>> I can confirm that it fixes the build for me here under F22 on an 8
>> core machine, although it takes a long time to fail.
>>
>> Seems like something that should be reported upstream to mono. I
>> copied them on Richard's email but haven't seen any response yet.
>>
>
> Hi Chris,
>
> Thanks for coming back to me, at least we have an interim workaround then.
>
> You might consider putting a bug report up on Xamarin's bugzilla?
>
> http://www.mono-project.com/community/bugs/
>
> Cheers, Alex
>

I submitted it under "compilers" with the content of Richard's email
and a note at the time. There doesn't appear to be a component for the
build portion of mono.

Chris