From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail.chez-thomas.org (hermes.mlbassoc.com [64.234.241.98]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id 0AEEBE0030B for ; Sun, 13 May 2012 15:24:53 -0700 (PDT) Received: by mail.chez-thomas.org (Postfix, from userid 1998) id 246E6F81233; Sun, 13 May 2012 16:24:53 -0600 (MDT) X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hermes.chez-thomas.org X-Spam-Level: X-Spam-Status: No, score=-2.9 required=4.0 tests=ALL_TRUSTED,BAYES_00 autolearn=unavailable version=3.3.2 Received: from hermes.chez-thomas.org (localhost.localdomain [127.0.0.1]) by mail.chez-thomas.org (Postfix) with ESMTP id CB287F81209; Sun, 13 May 2012 16:24:51 -0600 (MDT) Message-ID: <4FB034B3.9070505@mlbassoc.com> Date: Sun, 13 May 2012 16:24:51 -0600 From: Gary Thomas User-Agent: Mozilla/5.0 (X11; Linux i686; rv:12.0) Gecko/20120430 Thunderbird/12.0.1 MIME-Version: 1.0 To: Richard Purdie References: <4F8493BB.5070400@mlbassoc.com> <1334100422.10826.99.camel@ted> <4F84CCE3.1060504@mlbassoc.com> <4F84E00D.7030302@mlbassoc.com> <4F8D5F61.1010002@mlbassoc.com> <1334674913.616.98.camel@ted> <4F8D8A73.3030408@mlbassoc.com> <1334677494.616.101.camel@ted> <4F8D934D.9070704@mlbassoc.com> <1334679589.616.106.camel@ted> <4F8DA181.9070005@mlbassoc.com> <1334697649.616.138.camel@ted> <4F8DEB4A.7020401@mlbassoc.com> <1336912769.2711.16.camel@ted> In-Reply-To: <1336912769.2711.16.camel@ted> Cc: poky@yoctoproject.org Subject: Re: SRC checksum checking broken X-BeenThere: poky@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Poky build system developer discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 May 2012 22:24:54 -0000 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 2012-05-13 06:39, Richard Purdie wrote: > On Tue, 2012-04-17 at 16:14 -0600, Gary Thomas wrote: >> On 2012-04-17 15:20, Richard Purdie wrote: >>> On Tue, 2012-04-17 at 10:59 -0600, Gary Thomas wrote: >>>> On 2012-04-17 10:19, Richard Purdie wrote: >>>> Well, it seems that the checksums are encouraged, if not required, these days. >>>> I was just making sure that they actually work& in my opinion, it shouldn't >>>> matter how you got the file, the checksums should still be checked and match. >>> >>> You can argue this both ways. I'm leaning that direction although it has >>> its risks. >>> >>>> Sadly, this is much worse. It even [somehow] reached "through" my >>>> mirror setup and deleted the file on the backing store (i.e. the >>>> file /work/misc/Poky/sources/busybox-1.19.4.tar.bz2 gets deleted >>>> when the checksum fails even though it's part of the own-mirror) >>> >>> Was that the only issue? I can see how it managed to do that, I agree it >>> shouldn't :/. >> >> It sort of worked - at least it didn't pass silently - but the messages >> don't say why it failed. Here's what I get: >> >> NOTE: package busybox-1.19.4-r2: task do_fetch: Started >> WARNING: Failed to fetch URL http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball >> ERROR: Fetcher failure: Fetch command export HOME="/home/gthomas"; export GIT_CONFIG="/home/local/poky_test/tmp/sysroots/i686-linux/etc/gitconfig"; export >> PATH="/home/local/poky_test/tmp/sysroots/i686-linux/usr/bin/armv7a-vfp-neon-poky-linux-gnueabi:/home/local/poky_test/tmp/sysroots/beagleboard/usr/bin/crossscripts:/home/local/poky_test/tmp/sysroots/i686-linux/usr/sbin:/home/local/poky_test/tmp/sysroots/i686-linux/usr/bin:/home/local/poky_test/tmp/sysroots/i686-linux/sbin:/home/local/poky_test/tmp/sysroots/i686-linux//bin:/home/local/poky-master/scripts:/home/local/poky-master/bitbake/bin/:/opt/amltd/bin:/usr/java/jdk1.6.0_10/bin:/home/gthomas/Android/android-sdk-linux_x86-1.1_r1/tools:/home/gthomas/bin:/usr/lib/qt-3.3/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/lib/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/local/poky-master/scripts"; >> /usr/bin/env wget -t 5 -nv --passive-ftp --no-check-certificate -P /home/local/poky_test/downloads 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2' could not be run: >> None >> ERROR: Function failed: Fetcher failure for URL: 'http://www.busybox.net/downloads/busybox-1.19.4.tar.bz2;name=tarball'. Unable to fetch URL from any source. >> ERROR: Logfile of failure stored in: /home/local/poky_test/tmp/work/armv7a-vfp-neon-poky-linux-gnueabi/busybox-1.19.4-r2/temp/log.do_fetch.7907 >> NOTE: package busybox-1.19.4-r2: task do_fetch: Failed >> ERROR: Task 2 (/home/local/poky-master/meta/recipes-core/busybox/busybox_1.19.4.bb, do_fetch) failed with exit code '1' >> NOTE: Tasks Summary: Attempted 8 tasks of which 7 didn't need to be rerun and 1 failed. >> >> No indication of checksum failures anywhere. > > Having gone over this several times, I think the original patch is > correct but it highlights some other issues. The nastiest of those is > the deletion of files. I think I've found a way of fixing that by > correctly using fetcher clean functions (which are null operations for > the local fetcher). > > The remaining issue is then one of better output from the fetcher as > there wasn't enough info in the above logs but that is really a separate > problem. > > I've sent out several fetcher patches to the bitbake list which will > hopefully address some of these issues. I'm travelling at the moment and > these were written without internet access so my testing is limited to > the local file:// urls but I'm confident they move things in the right > direction. Is there something I should check wrt this problem? A bitbake URL/version? -- ------------------------------------------------------------ Gary Thomas | Consulting for the MLB Associates | Embedded world ------------------------------------------------------------