[PATCH 0/1] ghostscript: fix parallel build issue

[PATCH 0/1] ghostscript: fix parallel build issue

[Kang Kai]

From: Kang Kai <kai.kang@windriver.com>

Hi Saul,

This commit is for Yocto #1202: ghostscript do_compile fail on autobuilder
for crownbay-noemgd and qemux86-64.

As you told, I use 'cp -f' instead of cp. But I didn't have environment to test,
just check that build log is fine. 

So Jiajun could you please help to test? Thank you!

Regards,

The following changes since commit 860a41bae6b863a289b06a9684d9cf6c58a307bd:

  arch-ia32.inc: Fix up TUNE_ARCH variable conflicts (2011-07-26 22:39:59 +0100)

are available in the git repository at:
  git://git.pokylinux.org/poky-contrib kangkai/gs
  http://git.pokylinux.org/cgit.cgi/poky-contrib/log/?h=kangkai/gs

Kang Kai (1):
  ghostscript: fix parallel build issue

 .../ghostscript-9.02-parallel-make.patch           |   17 +++++++++++++++++
 .../ghostscript/ghostscript_9.02.bb                |    3 ++-
 2 files changed, 19 insertions(+), 1 deletions(-)
 create mode 100644 meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-make.patch

-- 
1.7.5.1.300.gc565c

[PATCH 1/1] ghostscript: fix parallel build issue

[Kang Kai]

From: Kang Kai <kai.kang@windriver.com>

ghostscript fails some time on autobuilder, it seems a parallel build issue.
Add patch to fix it.

Fixes [Yocto #1202]

Signed-off-by: Kang Kai <kai.kang@windriver.com>
---
 .../ghostscript-9.02-parallel-make.patch           |   17 +++++++++++++++++
 .../ghostscript/ghostscript_9.02.bb                |    3 ++-
 2 files changed, 19 insertions(+), 1 deletions(-)
 create mode 100644 meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-make.patch

diff --git a/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-make.patch b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-make.patch
new file mode 100644
index 0000000..76d1676
--- /dev/null
+++ b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-make.patch
@@ -0,0 +1,17 @@
+When parallel make it will fail with multi copy, see
+http://bugzilla.pokylinux.org/show_bug.cgi?id=1202
+
+Upstream-Status: Pending
+
+Signed-off-by: Kang Kai <kai.kang@windriver.com>
+--- ghostscript-9.02/base/unixhead.mak.orig	2011-07-27 17:06:17.749456100 +0800
++++ ghostscript-9.02/base/unixhead.mak	2011-07-27 17:06:37.449456100 +0800
+@@ -54,7 +54,7 @@
+ 
+ # Define generic commands.
+ 
+-CP_=cp
++CP_=cp -f
+ RM_=rm -f
+ RMN_=rm -f
+ 
diff --git a/meta/recipes-extended/ghostscript/ghostscript_9.02.bb b/meta/recipes-extended/ghostscript/ghostscript_9.02.bb
index 02038ea..28c6c9e 100644
--- a/meta/recipes-extended/ghostscript/ghostscript_9.02.bb
+++ b/meta/recipes-extended/ghostscript/ghostscript_9.02.bb
@@ -15,7 +15,7 @@ SECTION = "console/utils"
 LICENSE = "GPLv3"
 LIC_FILES_CHKSUM = "file://LICENSE;md5=d151214b3131251dfc9d858593acbd24"
 
-PR = "r3"
+PR = "r4"
 
 DEPENDS = "${PN}-native tiff jpeg fontconfig cups"
 DEPENDS_virtclass-native = ""
@@ -27,6 +27,7 @@ SRC_URI = "${SRC_URI_BASE} \
            file://ghostscript-9.02-genarch.patch \
            file://objarch.h \
            file://soobjarch.h \
+           file://ghostscript-9.02-parallel-make.patch \
            "
 SRC_URI_virtclass-native = "${SRC_URI_BASE}"
 
-- 
1.7.5.1.300.gc565c

Re: [PATCH 1/1] ghostscript: fix parallel build issue

[Richard Purdie]

On Wed, 2011-07-27 at 17:34 +0800, Kang Kai wrote:
> From: Kang Kai <kai.kang@windriver.com>
> 
> ghostscript fails some time on autobuilder, it seems a parallel build issue.
> Add patch to fix it.
> 
> Fixes [Yocto #1202]
> 
> Signed-off-by: Kang Kai <kai.kang@windriver.com>

Merged to master, thanks.

Richard

Re: [PATCH 1/1] ghostscript: fix parallel build issue

[Khem Raj]

On Wednesday, July 27, 2011 05:34:45 PM Kang Kai wrote:
> From: Kang Kai <kai.kang@windriver.com>
> 
> ghostscript fails some time on autobuilder, it seems a parallel build issue.
> Add patch to fix it.
> 
> Fixes [Yocto #1202]
> 
> Signed-off-by: Kang Kai <kai.kang@windriver.com>
> ---
>  .../ghostscript-9.02-parallel-make.patch           |   17 +++++++++++++++++
> .../ghostscript/ghostscript_9.02.bb                |    3 ++-
>  2 files changed, 19 insertions(+), 1 deletions(-)
>  create mode 100644
> meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-mak
> e.patch
> 
> diff --git
> a/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
> ake.patch
> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
> ake.patch new file mode 100644
> index 0000000..76d1676
> --- /dev/null
> +++
> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
> ake.patch @@ -0,0 +1,17 @@
> +When parallel make it will fail with multi copy, see
> +http://bugzilla.pokylinux.org/show_bug.cgi?id=1202
> +
> +Upstream-Status: Pending
> +
> +Signed-off-by: Kang Kai <kai.kang@windriver.com>
> +--- ghostscript-9.02/base/unixhead.mak.orig	2011-07-27 17:06:17.749456100
> +0800 ++++ ghostscript-9.02/base/unixhead.mak	2011-07-27 17:06:37.449456100
> +0800 +@@ -54,7 +54,7 @@
> +
> + # Define generic commands.
> +
> +-CP_=cp
> ++CP_=cp -f

It means it will first delete the target if it exists. Did you check if this 
is correct behavior ?

-- 
Khem Raj

Re: [PATCH 1/1] ghostscript: fix parallel build issue

[Saul Wold]

On 07/30/2011 11:20 AM, Khem Raj wrote:
> On Wednesday, July 27, 2011 05:34:45 PM Kang Kai wrote:
>> From: Kang Kai<kai.kang@windriver.com>
>>
>> ghostscript fails some time on autobuilder, it seems a parallel build issue.
>> Add patch to fix it.
>>
>> Fixes [Yocto #1202]
>>
>> Signed-off-by: Kang Kai<kai.kang@windriver.com>
>> ---
>>   .../ghostscript-9.02-parallel-make.patch           |   17 +++++++++++++++++
>> .../ghostscript/ghostscript_9.02.bb                |    3 ++-
>>   2 files changed, 19 insertions(+), 1 deletions(-)
>>   create mode 100644
>> meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-mak
>> e.patch
>>
>> diff --git
>> a/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>> ake.patch
>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>> ake.patch new file mode 100644
>> index 0000000..76d1676
>> --- /dev/null
>> +++
>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>> ake.patch @@ -0,0 +1,17 @@
>> +When parallel make it will fail with multi copy, see
>> +http://bugzilla.pokylinux.org/show_bug.cgi?id=1202
>> +
>> +Upstream-Status: Pending
>> +
>> +Signed-off-by: Kang Kai<kai.kang@windriver.com>
>> +--- ghostscript-9.02/base/unixhead.mak.orig	2011-07-27 17:06:17.749456100
>> +0800 ++++ ghostscript-9.02/base/unixhead.mak	2011-07-27 17:06:37.449456100
>> +0800 +@@ -54,7 +54,7 @@
>> +
>> + # Define generic commands.
>> +
>> +-CP_=cp
>> ++CP_=cp -f
>
> It means it will first delete the target if it exists. Did you check if this
> is correct behavior ?
>
Khem,

As far as I know the file is that is being copied to is the same file 
and the CP is only used in that case, the 2 files are copied to the same 
location due to the Parallel make.

Sau!

Re: [PATCH 1/1] ghostscript: fix parallel build issue

[Tom Rini]

On 08/01/2011 03:28 PM, Saul Wold wrote:
> On 07/30/2011 11:20 AM, Khem Raj wrote:
>> On Wednesday, July 27, 2011 05:34:45 PM Kang Kai wrote:
>>> From: Kang Kai<kai.kang@windriver.com>
>>>
>>> ghostscript fails some time on autobuilder, it seems a parallel build
>>> issue.
>>> Add patch to fix it.
>>>
>>> Fixes [Yocto #1202]
>>>
>>> Signed-off-by: Kang Kai<kai.kang@windriver.com>
>>> ---
>>>   .../ghostscript-9.02-parallel-make.patch           |   17
>>> +++++++++++++++++
>>> .../ghostscript/ghostscript_9.02.bb                |    3 ++-
>>>   2 files changed, 19 insertions(+), 1 deletions(-)
>>>   create mode 100644
>>> meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-mak
>>>
>>> e.patch
>>>
>>> diff --git
>>> a/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>>>
>>> ake.patch
>>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>>>
>>> ake.patch new file mode 100644
>>> index 0000000..76d1676
>>> --- /dev/null
>>> +++
>>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>>>
>>> ake.patch @@ -0,0 +1,17 @@
>>> +When parallel make it will fail with multi copy, see
>>> +http://bugzilla.pokylinux.org/show_bug.cgi?id=1202
>>> +
>>> +Upstream-Status: Pending
>>> +
>>> +Signed-off-by: Kang Kai<kai.kang@windriver.com>
>>> +--- ghostscript-9.02/base/unixhead.mak.orig    2011-07-27
>>> 17:06:17.749456100
>>> +0800 ++++ ghostscript-9.02/base/unixhead.mak    2011-07-27
>>> 17:06:37.449456100
>>> +0800 +@@ -54,7 +54,7 @@
>>> +
>>> + # Define generic commands.
>>> +
>>> +-CP_=cp
>>> ++CP_=cp -f
>>
>> It means it will first delete the target if it exists. Did you check
>> if this
>> is correct behavior ?
>>
> Khem,
> 
> As far as I know the file is that is being copied to is the same file
> and the CP is only used in that case, the 2 files are copied to the same
> location due to the Parallel make.

Er, that sounds like we're just changing the race around.  Now we could
get an incomplete file?

-- 
Tom Rini
Mentor Graphics Corporation

Re: [PATCH 1/1] ghostscript: fix parallel build issue

[Phil Blundell]

On Mon, 2011-08-01 at 15:51 -0700, Tom Rini wrote:
> On 08/01/2011 03:28 PM, Saul Wold wrote:
> > On 07/30/2011 11:20 AM, Khem Raj wrote:
> >> On Wednesday, July 27, 2011 05:34:45 PM Kang Kai wrote:
> >>> From: Kang Kai<kai.kang@windriver.com>
> >>>
> >>> ghostscript fails some time on autobuilder, it seems a parallel build
> >>> issue.
> >>> Add patch to fix it.
> >>>
> >>> Fixes [Yocto #1202]
> >>>
> >>> Signed-off-by: Kang Kai<kai.kang@windriver.com>
> >>> ---
> >>>   .../ghostscript-9.02-parallel-make.patch           |   17
> >>> +++++++++++++++++
> >>> .../ghostscript/ghostscript_9.02.bb                |    3 ++-
> >>>   2 files changed, 19 insertions(+), 1 deletions(-)
> >>>   create mode 100644
> >>> meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-mak
> >>>
> >>> e.patch
> >>>
> >>> diff --git
> >>> a/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
> >>>
> >>> ake.patch
> >>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
> >>>
> >>> ake.patch new file mode 100644
> >>> index 0000000..76d1676
> >>> --- /dev/null
> >>> +++
> >>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
> >>>
> >>> ake.patch @@ -0,0 +1,17 @@
> >>> +When parallel make it will fail with multi copy, see
> >>> +http://bugzilla.pokylinux.org/show_bug.cgi?id=1202
> >>> +
> >>> +Upstream-Status: Pending
> >>> +
> >>> +Signed-off-by: Kang Kai<kai.kang@windriver.com>
> >>> +--- ghostscript-9.02/base/unixhead.mak.orig    2011-07-27
> >>> 17:06:17.749456100
> >>> +0800 ++++ ghostscript-9.02/base/unixhead.mak    2011-07-27
> >>> 17:06:37.449456100
> >>> +0800 +@@ -54,7 +54,7 @@
> >>> +
> >>> + # Define generic commands.
> >>> +
> >>> +-CP_=cp
> >>> ++CP_=cp -f
> >>
> >> It means it will first delete the target if it exists. Did you check
> >> if this
> >> is correct behavior ?
> >>
> > Khem,
> > 
> > As far as I know the file is that is being copied to is the same file
> > and the CP is only used in that case, the 2 files are copied to the same
> > location due to the Parallel make.
> 
> Er, that sounds like we're just changing the race around.  Now we could
> get an incomplete file?

I don't think you would get an incomplete file, but using "cp -f" just
makes the race less likely rather than eliminating it.  You can still
get:

cp 1			cp 2
open(foo) = -EACCESS
unlink(foo)
			open(foo) = 0
open(foo) = -EACCESS
exit(1)
			write()
			exit(0)

if the two copies of cp end up running at the same time.

It seems pretty clear that the right fix is to figure out why this race
is happening in the first place and adjust the make rules to avoid it,
rather than trying to paper over it by making the conflict harmless.  If
that's hard/impossible for any reason then "cp -n" might possibly be
acceptable since then the copy of cp that loses the race will just do
nothing harmlessly.  I don't think -n is POSIX though so this is
definitely a less-good workaround.

p.

Re: [PATCH 1/1] ghostscript: fix parallel build issue

[Khem Raj]

On Mon, Aug 1, 2011 at 3:28 PM, Saul Wold <sgw@linux.intel.com> wrote:
> On 07/30/2011 11:20 AM, Khem Raj wrote:
>>
>> On Wednesday, July 27, 2011 05:34:45 PM Kang Kai wrote:
>>>
>>> From: Kang Kai<kai.kang@windriver.com>
>>>
>>> ghostscript fails some time on autobuilder, it seems a parallel build
>>> issue.
>>> Add patch to fix it.
>>>
>>> Fixes [Yocto #1202]
>>>
>>> Signed-off-by: Kang Kai<kai.kang@windriver.com>
>>> ---
>>>  .../ghostscript-9.02-parallel-make.patch           |   17
>>> +++++++++++++++++
>>> .../ghostscript/ghostscript_9.02.bb                |    3 ++-
>>>  2 files changed, 19 insertions(+), 1 deletions(-)
>>>  create mode 100644
>>>
>>> meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-mak
>>> e.patch
>>>
>>> diff --git
>>>
>>> a/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>>> ake.patch
>>>
>>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>>> ake.patch new file mode 100644
>>> index 0000000..76d1676
>>> --- /dev/null
>>> +++
>>>
>>> b/meta/recipes-extended/ghostscript/ghostscript/ghostscript-9.02-parallel-m
>>> ake.patch @@ -0,0 +1,17 @@
>>> +When parallel make it will fail with multi copy, see
>>> +http://bugzilla.pokylinux.org/show_bug.cgi?id=1202
>>> +
>>> +Upstream-Status: Pending
>>> +
>>> +Signed-off-by: Kang Kai<kai.kang@windriver.com>
>>> +--- ghostscript-9.02/base/unixhead.mak.orig    2011-07-27
>>> 17:06:17.749456100
>>> +0800 ++++ ghostscript-9.02/base/unixhead.mak   2011-07-27
>>> 17:06:37.449456100
>>> +0800 +@@ -54,7 +54,7 @@
>>> +
>>> + # Define generic commands.
>>> +
>>> +-CP_=cp
>>> ++CP_=cp -f
>>
>> It means it will first delete the target if it exists. Did you check if
>> this
>> is correct behavior ?
>>
> Khem,
>
> As far as I know the file is that is being copied to is the same file and
> the CP is only used in that case, the 2 files are copied to the same
> location due to the Parallel make.

if thats the case then probably checking for existence of file before
copying it over
might be one approach