From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id 8964DE007CC; Wed, 29 Apr 2015 10:40:03 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,HTML_MESSAGE, RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [216.31.210.63 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 HTML_MESSAGE BODY: HTML included in message Received: from mail-gw2-out.broadcom.com (mail-gw2-out.broadcom.com [216.31.210.63]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id 9D902E0095D for ; Wed, 29 Apr 2015 10:39:51 -0700 (PDT) X-IronPort-AV: E=Sophos;i="5.11,671,1422950400"; d="scan'208,217";a="63470385" Received: from irvexchcas06.broadcom.com (HELO IRVEXCHCAS06.corp.ad.broadcom.com) ([10.9.208.53]) by mail-gw2-out.broadcom.com with ESMTP; 29 Apr 2015 10:47:27 -0700 Received: from SJEXCHCAS06.corp.ad.broadcom.com (10.16.203.14) by IRVEXCHCAS06.corp.ad.broadcom.com (10.9.208.53) with Microsoft SMTP Server (TLS) id 14.3.235.1; Wed, 29 Apr 2015 10:39:49 -0700 Received: from SJEXCHMB12.corp.ad.broadcom.com ([fe80::bc15:c1e1:c29a:36f7]) by SJEXCHCAS06.corp.ad.broadcom.com ([::1]) with mapi id 14.03.0235.001; Wed, 29 Apr 2015 10:39:48 -0700 From: "Joel (Xi Zhou) Zhou" To: "yocto@yoctoproject.org" Thread-Topic: Kernel customized do_fetch issue Thread-Index: AdCCo3ucpO3id1frRu2TC2HCA6qcDA== Date: Wed, 29 Apr 2015 17:39:46 +0000 Message-ID: <9F136EE5FB53D64397ED1089A0E760E0162CD671@SJEXCHMB12.corp.ad.broadcom.com> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.16.203.100] MIME-Version: 1.0 Subject: Kernel customized do_fetch issue X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Apr 2015 17:40:03 -0000 Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_9F136EE5FB53D64397ED1089A0E760E0162CD671SJEXCHMB12corpa_" --_000_9F136EE5FB53D64397ED1089A0E760E0162CD671SJEXCHMB12corpa_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi all, I created a do_fetch() for checkout in-house git repo, which is working fin= e with OE. do_fetch() { cd ${WORKDIR} rm -rf ${PN}-${PV} git clone ssh://svcswgit@git-ccxsw.inhouse.com/linux-lsk ${PN}-${PV} cd ${PN}-${PV} git checkout ${KBRANCH} } With Yocto, the do_fetch() does its job, but do_configure create an issue. do_configure_prepend() { cp ${WORKDIR}/${KERNEL_CONFIG_FILE} ${S}/.config oe_runmake oldconfig } The do_configure error message: | make: *** No rule to make target `oldconfig'. Stop. Basically, the kernel source checkout by do_fetch() is delete/erase while r= unning do_configure(). I suspect some tasks between do_fetch and do_configure are doing some magic= work of moving the kernel source around. Any suggestion? Thanks, Joel --_000_9F136EE5FB53D64397ED1089A0E760E0162CD671SJEXCHMB12corpa_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi all,

I created a do_fetch() for checkout in-house git rep= o, which is working fine with OE.

do_fetch() {

cd ${W= ORKDIR}

rm -rf= ${PN}-${PV}

git cl= one ssh://svcswgit@git-ccxsw.inhouse.com/linux-lsk ${PN}-${PV}

cd ${P= N}-${PV}

git ch= eckout ${KBRANCH}

}

With Yocto, the do_fetch() does its job, but do_conf= igure create an issue.

do_configure_prepend() {<= o:p>

cp ${W= ORKDIR}/${KERNEL_CONFIG_FILE} ${S}/.config

oe_run= make oldconfig

}

The do_configure error message:

| make: *** No rule to ma= ke target `oldconfig'. Stop.

Basically, the kernel source checkout by do_fetch() = is delete/erase while running do_configure().

I suspect some tasks between do_fetch and do_configu= re are doing some magic work of moving the kernel source around.=

Any suggestion?

Thanks,

Joel

--_000_9F136EE5FB53D64397ED1089A0E760E0162CD671SJEXCHMB12corpa_-- From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id 728B2E0095D; Wed, 29 Apr 2015 10:52:21 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [147.11.1.11 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] Received: from mail.windriver.com (mail.windriver.com [147.11.1.11]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id 3AB85E007B9 for ; Wed, 29 Apr 2015 10:52:19 -0700 (PDT) Received: from ALA-HCA.corp.ad.wrs.com (ala-hca.corp.ad.wrs.com [147.11.189.40]) by mail.windriver.com (8.14.9/8.14.9) with ESMTP id t3THqHvQ018263 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Wed, 29 Apr 2015 10:52:17 -0700 (PDT) Received: from [128.224.56.48] (128.224.56.48) by ALA-HCA.corp.ad.wrs.com (147.11.189.50) with Microsoft SMTP Server id 14.3.224.2; Wed, 29 Apr 2015 10:52:16 -0700 Message-ID: <55411A50.3030304@windriver.com> Date: Wed, 29 Apr 2015 13:52:16 -0400 From: Bruce Ashfield User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: "Joel (Xi Zhou) Zhou" , "yocto@yoctoproject.org" References: <9F136EE5FB53D64397ED1089A0E760E0162CD671@SJEXCHMB12.corp.ad.broadcom.com> In-Reply-To: <9F136EE5FB53D64397ED1089A0E760E0162CD671@SJEXCHMB12.corp.ad.broadcom.com> Subject: Re: Kernel customized do_fetch issue X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Apr 2015 17:52:21 -0000 Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit On 2015-04-29 01:39 PM, Joel (Xi Zhou) Zhou wrote: > Hi all, > > I created a do_fetch() for checkout in-house git repo, which is working > fine with OE. > > do_fetch() { > > cd ${WORKDIR} > > rm -rf ${PN}-${PV} > > git clone ssh://svcswgit@git-ccxsw.inhouse.com/linux-lsk ${PN}-${PV} > > cd ${PN}-${PV} > > git checkout ${KBRANCH} > > } > > With Yocto, the do_fetch() does its job, but do_configure create an issue. > > do_configure_prepend() { > > cp ${WORKDIR}/${KERNEL_CONFIG_FILE} ${S}/.config > > oe_runmake oldconfig > > } > > The do_configure error message: > > | make: *** No rule to make target `oldconfig'. Stop. > > Basically, the kernel source checkout by do_fetch() is delete/erase > while running do_configure(). > > I suspect some tasks between do_fetch and do_configure are doing some > magic work of moving the kernel source around. It's better if you can post your entire kernel recipe, and what branch/release you are using. There are steps that move the kernel source into work-shared, so that may be impacting your flow. But the question has to be asked. Why exactly are you manually fetching the kernel ? The fetcher can take care of most everything. If you need to modify the source directory later, have a look at the steps that I'm taking in kernel-yocto.bbclass, since that works properly within the fetcher and build infrastructure. Bruce > > Any suggestion? > > Thanks, > > Joel > > > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id 3D487E0095D; Wed, 29 Apr 2015 11:09:04 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [216.31.210.63 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] Received: from mail-gw2-out.broadcom.com (mail-gw2-out.broadcom.com [216.31.210.63]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id DAE7AE007B9 for ; Wed, 29 Apr 2015 11:09:01 -0700 (PDT) X-IronPort-AV: E=Sophos;i="5.11,671,1422950400"; d="scan'208";a="63476699" Received: from irvexchcas06.broadcom.com (HELO IRVEXCHCAS06.corp.ad.broadcom.com) ([10.9.208.53]) by mail-gw2-out.broadcom.com with ESMTP; 29 Apr 2015 11:16:40 -0700 Received: from SJEXCHCAS04.corp.ad.broadcom.com (10.16.203.10) by IRVEXCHCAS06.corp.ad.broadcom.com (10.9.208.53) with Microsoft SMTP Server (TLS) id 14.3.235.1; Wed, 29 Apr 2015 11:09:01 -0700 Received: from SJEXCHMB12.corp.ad.broadcom.com ([fe80::bc15:c1e1:c29a:36f7]) by SJEXCHCAS04.corp.ad.broadcom.com ([::1]) with mapi id 14.03.0235.001; Wed, 29 Apr 2015 11:08:59 -0700 From: "Joel (Xi Zhou) Zhou" To: Bruce Ashfield , "yocto@yoctoproject.org" Thread-Topic: [yocto] Kernel customized do_fetch issue Thread-Index: AdCCo3ucpO3id1frRu2TC2HCA6qcDAAPGt4AAA5k2WA= Date: Wed, 29 Apr 2015 18:08:59 +0000 Message-ID: <9F136EE5FB53D64397ED1089A0E760E0162CD6BD@SJEXCHMB12.corp.ad.broadcom.com> References: <9F136EE5FB53D64397ED1089A0E760E0162CD671@SJEXCHMB12.corp.ad.broadcom.com> <55411A50.3030304@windriver.com> In-Reply-To: <55411A50.3030304@windriver.com> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.16.203.100] MIME-Version: 1.0 Subject: Re: Kernel customized do_fetch issue X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Apr 2015 18:09:04 -0000 Content-Language: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable > But the question has to be asked. Why exactly are you manually fetching > the kernel ? The fetcher can take care of most everything. The whole story is starting at the url of our git repo. We have a git URL l= ike: ssh://svcswgit@git-ccxsw.inhouse.com/linux-lsk So the SRC_URI like this, but the fetcher try to apply "scp" over it. KBRANCH=3D 3.14_common_dev SRC_URI =3D "ssh://svcswgit@git-ccxsw.inhouse.com/linux-lsk;bareclone=3D1;= branch=3D${KBRANCH}" Error: ERROR: Fetcher failure: Fetch command failed with exit code 1, output: FATAL: unknown git/gitolite command: 'scp -r -f linux-lsk' Then I change it according the suggestion in this mailing list: SRC_URI =3D "git://svcswgit@git-ccxsw.inhouse.com/linux-lsk;bareclone=3D1;= branch=3D${KBRANCH};protocol=3Dssh" This time "bitbake linux-lsk -c fetch" return no error, but the source fold= er in working directory is empty.=20 In log.do_fetch DEBUG: Fetcher failure: Fetch command failed with exit code 8, output: http://downloads.yoctoproject.org/mirror/sources/git2_git-ccxsw.rtp. inhou= se.com. linux-lsk.tar.gz: 2015-04-29 12:49:36 ERROR 404: Not Found. Thanks, Joel From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id A7716E0095D; Wed, 29 Apr 2015 12:22:46 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [147.11.146.13 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] Received: from mail1.windriver.com (mail1.windriver.com [147.11.146.13]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id AD6FAE007B9 for ; Wed, 29 Apr 2015 12:22:43 -0700 (PDT) Received: from ALA-HCA.corp.ad.wrs.com (ala-hca.corp.ad.wrs.com [147.11.189.40]) by mail1.windriver.com (8.14.9/8.14.9) with ESMTP id t3TJMaFS019884 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=FAIL); Wed, 29 Apr 2015 12:22:37 -0700 (PDT) Received: from [128.224.56.48] (128.224.56.48) by ALA-HCA.corp.ad.wrs.com (147.11.189.50) with Microsoft SMTP Server id 14.3.224.2; Wed, 29 Apr 2015 12:22:36 -0700 Message-ID: <55412F7C.8050700@windriver.com> Date: Wed, 29 Apr 2015 15:22:36 -0400 From: Bruce Ashfield User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.6.0 MIME-Version: 1.0 To: "Joel (Xi Zhou) Zhou" , "yocto@yoctoproject.org" References: <9F136EE5FB53D64397ED1089A0E760E0162CD671@SJEXCHMB12.corp.ad.broadcom.com> <55411A50.3030304@windriver.com> <9F136EE5FB53D64397ED1089A0E760E0162CD6BD@SJEXCHMB12.corp.ad.broadcom.com> In-Reply-To: <9F136EE5FB53D64397ED1089A0E760E0162CD6BD@SJEXCHMB12.corp.ad.broadcom.com> Subject: Re: Kernel customized do_fetch issue X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Apr 2015 19:22:46 -0000 Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit On 2015-04-29 02:08 PM, Joel (Xi Zhou) Zhou wrote: >> But the question has to be asked. Why exactly are you manually fetching >> the kernel ? The fetcher can take care of most everything. > > The whole story is starting at the url of our git repo. We have a git URL like: > ssh://svcswgit@git-ccxsw.inhouse.com/linux-lsk > > So the SRC_URI like this, but the fetcher try to apply "scp" over it. > KBRANCH= 3.14_common_dev > SRC_URI = "ssh://svcswgit@git-ccxsw.inhouse.com/linux-lsk;bareclone=1;branch=${KBRANCH}" > Error: > ERROR: Fetcher failure: Fetch command failed with exit code 1, output: > FATAL: unknown git/gitolite command: 'scp -r -f linux-lsk' > > Then I change it according the suggestion in this mailing list: > SRC_URI = "git://svcswgit@git-ccxsw.inhouse.com/linux-lsk;bareclone=1;branch=${KBRANCH};protocol=ssh" > > This time "bitbake linux-lsk -c fetch" return no error, but the source folder in working directory is empty. > In log.do_fetch > DEBUG: Fetcher failure: Fetch command failed with exit code 8, output: > http://downloads.yoctoproject.org/mirror/sources/git2_git-ccxsw.rtp. inhouse.com. linux-lsk.tar.gz: > 2015-04-29 12:49:36 ERROR 404: Not Found. I'd expect that it part of the log, since obviously the mirrors aren't going to have a copy of your kernel. You really aren't seeing anything land in the build/downloads/git2/ directory structure ? ssh fetches seem to work here. You'd be better of working through the issues and getting the right SRC_URI specification for the fetcher, since taking the fetch into a custom routine is going to short circuit parts of the build .. and you'll have to take care of them yourself. Cheers, Bruce > > Thanks, > Joel > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id 447A2E0095D; Wed, 29 Apr 2015 12:45:01 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=5.0 tests=BAYES_00,RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [216.31.210.62 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] Received: from mail-gw1-out.broadcom.com (mail-gw1-out.broadcom.com [216.31.210.62]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id 530CCE007B9 for ; Wed, 29 Apr 2015 12:44:57 -0700 (PDT) X-IronPort-AV: E=Sophos;i="5.11,672,1422950400"; d="scan'208";a="63657476" Received: from irvexchcas06.broadcom.com (HELO IRVEXCHCAS06.corp.ad.broadcom.com) ([10.9.208.53]) by mail-gw1-out.broadcom.com with ESMTP; 29 Apr 2015 13:13:31 -0700 Received: from SJEXCHCAS07.corp.ad.broadcom.com (10.16.203.16) by IRVEXCHCAS06.corp.ad.broadcom.com (10.9.208.53) with Microsoft SMTP Server (TLS) id 14.3.235.1; Wed, 29 Apr 2015 12:44:56 -0700 Received: from SJEXCHMB12.corp.ad.broadcom.com ([fe80::bc15:c1e1:c29a:36f7]) by SJEXCHCAS07.corp.ad.broadcom.com ([::1]) with mapi id 14.03.0235.001; Wed, 29 Apr 2015 12:44:51 -0700 From: "Joel (Xi Zhou) Zhou" To: Bruce Ashfield , "yocto@yoctoproject.org" Thread-Topic: [yocto] Kernel customized do_fetch issue Thread-Index: AdCCo3ucpO3id1frRu2TC2HCA6qcDAAPGt4AAA5k2WD//6YWAIAAcK5g Date: Wed, 29 Apr 2015 19:44:51 +0000 Message-ID: <9F136EE5FB53D64397ED1089A0E760E0162CD72C@SJEXCHMB12.corp.ad.broadcom.com> References: <9F136EE5FB53D64397ED1089A0E760E0162CD671@SJEXCHMB12.corp.ad.broadcom.com> <55411A50.3030304@windriver.com> <9F136EE5FB53D64397ED1089A0E760E0162CD6BD@SJEXCHMB12.corp.ad.broadcom.com> <55412F7C.8050700@windriver.com> In-Reply-To: <55412F7C.8050700@windriver.com> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.16.203.100] MIME-Version: 1.0 Subject: Re: Kernel customized do_fetch issue X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Apr 2015 19:45:01 -0000 Content-Language: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Thanks Bruce! > You really aren't seeing anything land in the build/downloads/git2/ > directory structure ? ssh fetches seem to work here. I do see something in build/downloads/git2/git-ccxsw.xxx.com.linux-lsk, but= it looks like an empty git. HEAD branches config description hooks info objects packed-refs refs I bring up this issue to IT department, what they said is, the Yocto expect= s the url contains host/repo, while gitolit requires host:repo. This is interesting since the Yocto documentation explicitly mentions gitol= ite in the SCM section: http://www.yoctoproject.org/docs/current/dev-manual/dev-manual.html#best-pr= actices-source-control-management Thanks, Joel