* Re: [oe-commits] Bruce Ashfield : kern-tools: improve patch application performance
2015-03-04 3:40 ` Bruce Ashfield
@ 2015-03-04 8:45 ` Martin Jansa
2015-03-04 12:58 ` Martin Jansa
1 sibling, 0 replies; 6+ messages in thread
From: Martin Jansa @ 2015-03-04 8:45 UTC (permalink / raw)
To: Bruce Ashfield; +Cc: openembedded-commits, openembedded-core
[-- Attachment #1: Type: text/plain, Size: 13819 bytes --]
On Tue, Mar 03, 2015 at 10:40:45PM -0500, Bruce Ashfield wrote:
> On 2015-03-03 9:23 PM, Martin Jansa wrote:
> > On Mon, Mar 02, 2015 at 10:05:50PM +0000, git@git.openembedded.org wrote:
> >> Module: openembedded-core.git
> >> Branch: master
> >> Commit: 148c78e0f5de2689de3ad9beaa9f6de618d87758
> >> URL: http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=148c78e0f5de2689de3ad9beaa9f6de618d87758
> >>
> >> Author: Bruce Ashfield <bruce.ashfield@windriver.com>
> >> Date: Mon Mar 2 16:36:41 2015 -0500
> >>
> >> kern-tools: improve patch application performance
> >>
> >> Update the SRCREV for the following incremental improvement in patch
> >> processing time:
> >>
> >> kgit-meta: skip patches on non-leaf nodes
> >>
> >> In a similar way as commit 0768d697 [kgit-meta: dont run kgit-s2q
> >> for
> >> non-leaf nodes], we can save even more processing time by not even
> >> analysing and linking patches if we aren't on the leaf node of the
> >> tree.
> >>
> >> This early exit can save nearly 95% of the time required to "patch"
> >> a tree when no changes are actually applied.
> >>
> >> Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>
> >> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> >
> > Not sure if it's related to this, but today's world build is failing
> > with:
> >
>
> No luck here. I was able to do a clean build of qemux86 against the 3.19
> kernel.
>
> I'll keep trying, but am looking for a reproducer at this point.
with qemux86-64 it failed a bit later:
| CC drivers/gpu/drm/i915/i915_suspend.o
| LD drivers/gpu/drm/panel/built-in.o
| CC lib/earlycpio.o
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/uapi/linux/ethtool.h:17:0,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/ethtool.h:16,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/netdevice.h:43,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/net/inet_sock.h:24,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/net/inet_connection_sock.h:23,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/net/ipv4/inet_connection_sock.c:19:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/if_ether.h:24:33: fatal error: uapi/linux/if_ether.h: No such file or directory
| #include <uapi/linux/if_ether.h>
| ^
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/uapi/asm/bootparam.h:32:0,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/asm/x86_init.h:5,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/asm/mpspec.h:6,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/arch/x86/include/asm/smp.h:11,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/smp.h:59,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/topology.h:33,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/gfp.h:8,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/slab.h:14,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/net/ipv6/addrlabel.c:16:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/screen_info.h:4:36: fatal error: uapi/linux/screen_info.h: No such file or directory
| #include <uapi/linux/screen_info.h>
| ^
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/spinlock.h:287:0,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/rcupdate.h:38,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/idr.h:18,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/kernfs.h:14,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/sysfs.h:15,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/kobject.h:21,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/cdev.h:4,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/drm/drmP.h:36,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/drivers/gpu/drm/i915/i915_suspend.c:27:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/spinlock_api_smp.h:190:34: fatal error: linux/rwlock_api_smp.h: No such file or directory
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/lib/earlycpio.c:28:0:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/earlycpio.h:4:25: fatal error: linux/types.h: No such file or directory
| #include <linux/types.h>
| ^
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/uapi/linux/timex.h:56:0,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/timex.h:56,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/sched.h:19,
| from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/lib/dump_stack.c:8:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/time.h:7:27: fatal error: linux/time64.h: No such file or directory
| compilation terminated.
| compilation terminated.
| In file included from /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/fs/nfs/super.c:33:0:
| /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/include/linux/sunrpc/clnt.h:23:32: fatal error: linux/sunrpc/timer.h: No such file or directory
| compilation terminated.
| make[3]: *** [lib/earlycpio.o] Error 1
| make[3]: *** Waiting for unfinished jobs....
| make[6]: *** [drivers/gpu/drm/i915/i915_suspend.o] Error 1
| make[5]: *** [drivers/gpu/drm/i915] Error 2
| make[4]: *** No rule to make target `net/ipv6/ip6_fib.o', needed by `net/ipv6/ipv6.o'. Stop.
| make[4]: *** Waiting for unfinished jobs....
| CC net/ipv6/route.o
| make[4]: *** [drivers/gpu/drm] Error 2
| make[3]: *** [lib/dump_stack.o] Error 1
| make[3]: *** [drivers/gpu] Error 2
| make[3]: *** Waiting for unfinished jobs....
| make[4]: *** [net/ipv4/inet_connection_sock.o] Error 1
| make[2]: *** [lib] Error 2
| make[2]: *** Waiting for unfinished jobs....
| make[4]: *** [net/ipv6/addrlabel.o] Error 1
| make[4]: *** [fs/nfs/super.o] Error 1
| make[3]: *** [net/ipv4] Error 2
| make[3]: *** Waiting for unfinished jobs....
| make[4]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[4]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'. Stop.
| make[5]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[5]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'. Stop.
| x86_64-oe-linux-gcc: error: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/net/ipv6/route.c: No such file or directory
| make[3]: *** [fs/nfs] Error 2
| make[3]: *** Waiting for unfinished jobs....
| make[3]: *** [net/mac80211] Error 2
| make[4]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[4]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'. Stop.
| x86_64-oe-linux-gcc: fatal error: no input files
| compilation terminated.
| make[5]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[5]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'. Stop.
| make[3]: *** [fs/notify] Error 2
| make[5]: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build: No such file or directory
| make[5]: *** No rule to make target `/home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/scripts/Makefile.build'. Stop.
| make[4]: *** [drivers/i2c/algos] Error 2
| make[4]: *** Waiting for unfinished jobs....
| make[4]: *** [drivers/i2c/busses] Error 2
| make[4]: *** [net/ipv6/route.o] Error 1
| make[3]: *** [net/ipv6] Error 2
| make[4]: *** [drivers/i2c/muxes] Error 2
| make[2]: *** [net] Error 2
| fixdep: error opening config file: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/fs/nls/nls_iso8859-1.c: No such file or directory
| make[4]: *** [fs/nls/nls_iso8859-1.o] Error 2
| make[3]: *** [fs/nls] Error 2
| make[2]: *** [fs] Error 2
| fixdep: error opening config file: /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86-64/kernel-source/drivers/i2c/i2c-core.c: No such file or directory
| make[4]: *** [drivers/i2c/i2c-core.o] Error 2
| make[3]: *** [drivers/i2c] Error 2
| make[2]: *** [drivers] Error 2
| make[1]: *** [sub-make] Error 2
| make: *** [__sub-make] Error 2
| ERROR: oe_runmake failed
| WARNING: exit code 1 from a shell command.
| ERROR: Function failed: do_compile (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86_64-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_compile.30660)
NOTE: recipe linux-yocto-3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0: task do_compile: Failed
> > ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401)
> > ERROR: Logfile of failure stored in: /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401
> > Log data follows:
> > | DEBUG: Executing shell function do_kernel_configme
> > | NOTE: kernel configme
> > | [INFO] Configuring target/machine combo: "standard/qemux86"
> > | [INFO] collecting configs in .meta/meta-series
> > | mv: cannot move `/home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/linux-qemux86-standard-build/.tmp.config.PKIfLNkSVj' to `.meta/cfg/standard/common-pc/qemux86-standard-config-3.19': No such file or directory
> > | creation of pre-processed config data failed
> > | config of "standard/qemux86" failed
> > | WARNING: exit code 1 from a shell command.
> > | ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401)
> > NOTE: recipe linux-yocto-3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0: task do_kernel_configme: Failed
> > ERROR: Task 30091 (/home/jenkins/oe/world/shr-core/openembedded-core/meta/recipes-kernel/linux/linux-yocto_3.19.bb, do_kernel_configme) failed with exit code '1'
> >
> >>
> >> ---
> >>
> >> meta/recipes-kernel/kern-tools/kern-tools-native_git.bb | 2 +-
> >> 1 file changed, 1 insertion(+), 1 deletion(-)
> >>
> >> diff --git a/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb b/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> index 80d26f9..131c5e9 100644
> >> --- a/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> +++ b/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> @@ -4,7 +4,7 @@ LIC_FILES_CHKSUM = "file://git/tools/kgit;beginline=5;endline=9;md5=d8d1d729a70c
> >>
> >> DEPENDS = "git-native"
> >>
> >> -SRCREV = "cab17f884998b43692244a863dea6f505c7f67af"
> >> +SRCREV = "0c51a3d02fa54726141f32824b11d0676960e0a5"
> >> PR = "r12"
> >> PV = "0.2+git${SRCPV}"
> >>
> >>
> >> --
> >> _______________________________________________
> >> Openembedded-commits mailing list
> >> Openembedded-commits@lists.openembedded.org
> >> http://lists.openembedded.org/mailman/listinfo/openembedded-commits
> >
>
--
Martin 'JaMa' Jansa jabber: Martin.Jansa@gmail.com
[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 188 bytes --]
^ permalink raw reply [flat|nested] 6+ messages in thread* Re: [oe-commits] Bruce Ashfield : kern-tools: improve patch application performance
2015-03-04 3:40 ` Bruce Ashfield
2015-03-04 8:45 ` Martin Jansa
@ 2015-03-04 12:58 ` Martin Jansa
2015-03-04 13:04 ` Richard Purdie
1 sibling, 1 reply; 6+ messages in thread
From: Martin Jansa @ 2015-03-04 12:58 UTC (permalink / raw)
To: Bruce Ashfield; +Cc: openembedded-commits, openembedded-core
[-- Attachment #1: Type: text/plain, Size: 5651 bytes --]
On Tue, Mar 03, 2015 at 10:40:45PM -0500, Bruce Ashfield wrote:
> On 2015-03-03 9:23 PM, Martin Jansa wrote:
> > On Mon, Mar 02, 2015 at 10:05:50PM +0000, git@git.openembedded.org wrote:
> >> Module: openembedded-core.git
> >> Branch: master
> >> Commit: 148c78e0f5de2689de3ad9beaa9f6de618d87758
> >> URL: http://git.openembedded.org/?p=openembedded-core.git&a=commit;h=148c78e0f5de2689de3ad9beaa9f6de618d87758
> >>
> >> Author: Bruce Ashfield <bruce.ashfield@windriver.com>
> >> Date: Mon Mar 2 16:36:41 2015 -0500
> >>
> >> kern-tools: improve patch application performance
> >>
> >> Update the SRCREV for the following incremental improvement in patch
> >> processing time:
> >>
> >> kgit-meta: skip patches on non-leaf nodes
> >>
> >> In a similar way as commit 0768d697 [kgit-meta: dont run kgit-s2q
> >> for
> >> non-leaf nodes], we can save even more processing time by not even
> >> analysing and linking patches if we aren't on the leaf node of the
> >> tree.
> >>
> >> This early exit can save nearly 95% of the time required to "patch"
> >> a tree when no changes are actually applied.
> >>
> >> Signed-off-by: Bruce Ashfield <bruce.ashfield@windriver.com>
> >> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> >
> > Not sure if it's related to this, but today's world build is failing
> > with:
> >
>
> No luck here. I was able to do a clean build of qemux86 against the 3.19
> kernel.
>
> I'll keep trying, but am looking for a reproducer at this point.
>
> Bruce
>
> > ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401)
> > ERROR: Logfile of failure stored in: /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401
> > Log data follows:
> > | DEBUG: Executing shell function do_kernel_configme
> > | NOTE: kernel configme
> > | [INFO] Configuring target/machine combo: "standard/qemux86"
> > | [INFO] collecting configs in .meta/meta-series
> > | mv: cannot move `/home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/linux-qemux86-standard-build/.tmp.config.PKIfLNkSVj' to `.meta/cfg/standard/common-pc/qemux86-standard-config-3.19': No such file or directory
> > | creation of pre-processed config data failed
> > | config of "standard/qemux86" failed
> > | WARNING: exit code 1 from a shell command.
> > | ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.29401)
> > NOTE: recipe linux-yocto-3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0: task do_kernel_configme: Failed
> > ERROR: Task 30091 (/home/jenkins/oe/world/shr-core/openembedded-core/meta/recipes-kernel/linux/linux-yocto_3.19.bb, do_kernel_configme) failed with exit code '1'
> >
And another one from restarted qemux86 build:
ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.22612)
ERROR: Logfile of failure stored in: /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.22612
Log data follows:
| DEBUG: Executing shell function do_kernel_configme
| NOTE: kernel configme
| [INFO] Configuring target/machine combo: "standard/qemux86"
| [INFO] collecting configs in .meta/meta-series
| ERROR: could not sanitize configuration fragments
| errors are logged in /home/jenkins/oe/world/shr-core/tmp-glibc/work-shared/qemux86/kernel-source/.meta/cfg/standard/common-pc/config.log
| WARNING: exit code 1 from a shell command.
| ERROR: Function failed: do_kernel_configme (log file is located at /home/jenkins/oe/world/shr-core/tmp-glibc/work/qemux86-oe-linux/linux-yocto/3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0/temp/log.do_kernel_configme.22612)
NOTE: recipe linux-yocto-3.19+gitAUTOINC+f7a81274b4_43b9eced9b-r0: task do_kernel_configme: Failed
I understand that these error logs aren't very helpful, but the tmpfs is already gone.
All I can say was that I wasn't seeing these issues until yesterday.
> >>
> >> ---
> >>
> >> meta/recipes-kernel/kern-tools/kern-tools-native_git.bb | 2 +-
> >> 1 file changed, 1 insertion(+), 1 deletion(-)
> >>
> >> diff --git a/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb b/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> index 80d26f9..131c5e9 100644
> >> --- a/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> +++ b/meta/recipes-kernel/kern-tools/kern-tools-native_git.bb
> >> @@ -4,7 +4,7 @@ LIC_FILES_CHKSUM = "file://git/tools/kgit;beginline=5;endline=9;md5=d8d1d729a70c
> >>
> >> DEPENDS = "git-native"
> >>
> >> -SRCREV = "cab17f884998b43692244a863dea6f505c7f67af"
> >> +SRCREV = "0c51a3d02fa54726141f32824b11d0676960e0a5"
> >> PR = "r12"
> >> PV = "0.2+git${SRCPV}"
> >>
> >>
> >> --
> >> _______________________________________________
> >> Openembedded-commits mailing list
> >> Openembedded-commits@lists.openembedded.org
> >> http://lists.openembedded.org/mailman/listinfo/openembedded-commits
> >
>
--
Martin 'JaMa' Jansa jabber: Martin.Jansa@gmail.com
[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 188 bytes --]
^ permalink raw reply [flat|nested] 6+ messages in thread