From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail.chez-thomas.org (mail.mlbassoc.com [65.100.170.105]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id E1889E002A6 for ; Mon, 24 Mar 2014 16:25:13 -0700 (PDT) Received: by mail.chez-thomas.org (Postfix, from userid 1998) id D9DB1F811E0; Mon, 24 Mar 2014 17:25:12 -0600 (MDT) X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hermes.chez-thomas.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=4.0 tests=ALL_TRUSTED,BAYES_00 autolearn=unavailable version=3.3.2 Received: from [192.168.1.114] (zeus [192.168.1.114]) by mail.chez-thomas.org (Postfix) with ESMTP id BA00FF811DA; Mon, 24 Mar 2014 17:25:11 -0600 (MDT) Message-ID: <5330BEDD.3020607@mlbassoc.com> Date: Mon, 24 Mar 2014 17:25:17 -0600 From: Gary Thomas User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Jate S References: <532CB035.2020703@mlbassoc.com> <532CB770.90004@mlbassoc.com> In-Reply-To: X-Enigmail-Version: 1.5.2 Cc: Yocto Project Subject: Re: linux-yocto fetch bottleneck X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Mar 2014 23:25:14 -0000 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit On 2014-03-24 17:18, Jate S wrote: > What is the name of the mirror tarball that's created? I am trying to > see if it worked. I saw no log messages stating "Creating tarball of > git repository". It will look something like this (for the opkg-utils_git recipe) downloads/git2_git.yoctoproject.org.opkg-utils.tar.gz You should then arrange to move/copy any of these tarballs to your mirror so you benefit from this the next time around (when building in a new/different build tree) > On Fri, Mar 21, 2014 at 6:04 PM, Gary Thomas wrote: >> On 2014-03-21 15:54, Jate S wrote: >>> The documentation has warnings of space usage. Will it start using >>> lots of space? If so, can I use it on a per mirror basis? >> >> Yes, the tarballs can be quite large, but they are incredibly useful >> with a local mirror. Especially when you consider that updating a GIT >> checkout, e.g. the Linux kernel. can take a *really* long time. >> >>> I am using a local mirror, so maybe the space usage will not be a problem. >> >> The space needed will not be terribly different than what you've already >> encountered without generating the tarballs. >> >> n.b. it's polite to keep replies on the mailing list so that everyone benefits. >> >>> On Fri, Mar 21, 2014 at 5:33 PM, Gary Thomas wrote: >>>> On 2014-03-21 15:27, Jate S wrote: >>>>> I am running into a bottleneck with the linux-yocto recipe on dora >>>>> 1.5.1. The fetch retrieves git2_git.yoctoproject.org.git.tar.gz, but >>>>> then it hits a bottleneck when it must do a git fetch to update to the >>>>> required references. The git server does not have high bandwdith. >>>>> >>>>> One workaround that I've found is to archive the git repository and >>>>> replace the tar.gz in the downloads directory. The recipe then finds >>>>> the required references. >>>>> >>>>> Would BB_GENERATE_MIRROR_TARBALLS actually take care of this? Any >>>>> other recommendations? >>>> >>>> Yes, that's exactly what BB_GENERATE_MIRROR_TARBALLS does. The updated >>>> tarball will end up in your downloads directory. If you use any sort of >>>> local mirror, you'll want to push the new tarball to it for the next time. >> >> -- >> ------------------------------------------------------------ >> Gary Thomas | Consulting for the >> MLB Associates | Embedded world >> ------------------------------------------------------------ -- ------------------------------------------------------------ Gary Thomas | Consulting for the MLB Associates | Embedded world ------------------------------------------------------------