[meta-java] openjdk: openjdk.tar.bz2 download time out due to sha256sum mismatch.

[meta-java] openjdk: openjdk.tar.bz2 download time out due to sha256sum mismatch.

[Ramajayam, Yugeraj]

Hi all,

I am trying to include java support for valleyisland-64 bsp.

I have followed all the Usage Instructions as mentioned in the meta-java About page.
I have also created a ./meta-netcontiki/recipes-sato/images/core-image-sato-%.bbappend with the following content in it:

IMAGE_INSTALL += "native-border-router libcoap"
IMAGE_INSTALL += "radvd"


IMAGE_INSTALL = "busybox modutils-initscripts initscripts opkg udev sysvinit netbase base-files base-passwd \
                 ${ROOTFS_PKGMANAGE_BOOTSTRAP} ${CORE_IMAGE_EXTRA_INSTALL} \
                openjdk-7-jre openjdk-7-vm-zero openjdk-7-vm-jamvm openjdk-7-vm-cacao \
                openjdk-6-jre openjdk-6-vm-zero openjdk-6-vm-jamvm openjdk-6-vm-cacao \
                strace dropbear binutils \
                classpath \
                classpath-common \
                classpath-examples \
                classpath-tools \
                jamvm \
                cacao \
                "

When I execute $ bitbake core-image-sato , I am having following error due to openjdk.tar.bz2 time out issue.
When I try to wget manually, the tar ball was downloaded fine and the md5sum and sha256sum matches accordingly.
The error message appears as below :

ln -sf /home/ilab/dev/build/poky/build/tmp/work/corei7-64-poky-linux/openjdk-7-jre/85b01-2.6.1-r6.1/39b2c4354d0a.tar.bz2 openjdk.tar.bz2

if ! echo "0168a0174ee47407139ee32458c4d2a298ba4f44260343b209250156e4da463f  openjdk.tar.bz2" \
          | /usr/bin/sha256sum --check ; \
        then \
          if test "xyes" = "xyes"; then \
            if [ -e openjdk.tar.bz2 ] ; then \
              mv openjdk.tar.bz2 openjdk.tar.bz2.old ; \
            fi ; \
            /usr/bin/wget http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar.bz2; \
            if ! echo "0168a0174ee47407139ee32458c4d2a298ba4f44260343b209250156e4da463f  openjdk.tar.bz2" \
              | /usr/bin/sha256sum --check ; then \
              echo "ERROR: Bad download of OpenJDK root zip"; false; \
            fi; \
          else \
            echo "ERROR: No up-to-date OpenJDK root zip available"; exit -1; \
          fi ; \
        fi ;

openjdk.tar.bz2: FAILED
/usr/bin/sha256sum: WARNING: 1 computed checksum did NOT match

--2015-09-25 17:00:34--  http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar.bz2

Resolving icedtea.classpath.org (icedtea.classpath.org)...
208.78.240.231

Connecting to icedtea.classpath.org (icedtea.classpath.org)|208.78.240.231|:80...
failed: Connection timed out.

Retrying.

The retrying process goes on and on.

Am I missing any settings or configurations? Please guide me.
Thanks in advance.

Regards,
RAJ

Re: [meta-java] openjdk: openjdk.tar.bz2 download time out due to sha256sum mismatch.

[Richard Leitner]

On 09/25/2015 11:25 AM, Ramajayam, Yugeraj wrote:
> Hi all,
> 
> I am trying to include java support for valleyisland-64 bsp.
> 
> I have followed all the Usage Instructions as mentioned in the meta-java
> About page.
> 
Your configuration looks fine!

> 
> When I execute $ bitbake core-image-sato , I am having following error
> due to openjdk.tar.bz2 time out issue.
> 
> When I try to wget manually, the tar ball was downloaded fine and the
> md5sum and sha256sum matches accordingly.
> 
> The error message appears as below :
...
> 
> *openjdk.tar.bz2: FAILED*
> */usr/bin/sha256sum: WARNING: 1 computed checksum did NOT match*
> * *
> *--2015-09-25 17:00:34-- 
> http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar.bz2*
> * *
> *Resolving icedtea.classpath.org (icedtea.classpath.org)...*
> *208.78.240.231*
> * *
> *Connecting to icedtea.classpath.org
> (icedtea.classpath.org)|208.78.240.231|:80...*
> *failed: Connection timed out.*
> * *
> *Retrying.*

IMHO it looks like the wget falls into a timeout. How long does the
"manual" wget download take?

You could try to increase the wget timeout in
bitbake/lib/bb/fetch2/wget.py and meta/conf/bitbake.conf to for example
100sec:

diff --git a/bitbake/lib/bb/fetch2/wget.py b/bitbake/lib/bb/fetch2/wget.py
--- a/bitbake/lib/bb/fetch2/wget.py
+++ b/bitbake/lib/bb/fetch2/wget.py
@@ -58,7 +58,7 @@ class Wget(FetchMethod):

         ud.localfile = data.expand(urllib.unquote(ud.basename), d)

-        self.basecmd = d.getVar("FETCHCMD_wget", True) or "/usr/bin/env
wget -t 2 -T 30 -nv --passive-ftp --no-check-certificate"
+        self.basecmd = d.getVar("FETCHCMD_wget", True) or "/usr/bin/env
wget -t 2 -T 100 -nv --passive-ftp --no-check-certificate"

     def _runwget(self, ud, d, command, quiet):

diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -575,7 +575,7 @@ XORG_MIRROR = "http://xorg.freedesktop.org/releases"

 FETCHCMD_svn = "/usr/bin/env svn --non-interactive --trust-server-cert"
 FETCHCMD_cvs = "/usr/bin/env cvs"
-FETCHCMD_wget = "/usr/bin/env wget -t 2 -T 30 -nv --passive-ftp
--no-check-certificate"
+FETCHCMD_wget = "/usr/bin/env wget -t 2 -T 100 -nv --passive-ftp
--no-check-certificate"
 FETCHCMD_bzr = "/usr/bin/env bzr"
 FETCHCMD_hg = "/usr/bin/env hg"


hope that helps!

best regards,
Richard L

Re: [meta-java] openjdk: openjdk.tar.bz2 download time out due to sha256sum mismatch.

[Ramajayam, Yugeraj]

> -----Original Message-----
> From: Richard Leitner [mailto:richard.leitner@skidata.com]
> Sent: Tuesday, September 29, 2015 7:40 PM
> To: openembedded-devel@lists.openembedded.org
> Cc: Ramajayam, Yugeraj <yugeraj.ramajayam@intel.com>; Sven Ebenfeld
> <sven.ebenfeld@gmail.com>
> Subject: Re: [meta-java] openjdk: openjdk.tar.bz2 download time out due to
> sha256sum mismatch.
> 
> On 09/25/2015 11:25 AM, Ramajayam, Yugeraj wrote:
> > Hi all,
> >
> > I am trying to include java support for valleyisland-64 bsp.
> >
> > I have followed all the Usage Instructions as mentioned in the
> > meta-java About page.
> >
> Your configuration looks fine!
> 
> >
> > When I execute $ bitbake core-image-sato , I am having following error
> > due to openjdk.tar.bz2 time out issue.
> >
> > When I try to wget manually, the tar ball was downloaded fine and the
> > md5sum and sha256sum matches accordingly.
> >
> > The error message appears as below :
> ...
> >
> > *openjdk.tar.bz2: FAILED*
> > */usr/bin/sha256sum: WARNING: 1 computed checksum did NOT match*
> > * *
> > *--2015-09-25 17:00:34--
> > http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar
> > .bz2*
> > * *
> > *Resolving icedtea.classpath.org (icedtea.classpath.org)...*
> > *208.78.240.231*
> > * *
> > *Connecting to icedtea.classpath.org
> > (icedtea.classpath.org)|208.78.240.231|:80...*
> > *failed: Connection timed out.*
> > * *
> > *Retrying.*
> 
> IMHO it looks like the wget falls into a timeout. How long does the "manual"
> wget download take?
> 
> You could try to increase the wget timeout in bitbake/lib/bb/fetch2/wget.py
> and meta/conf/bitbake.conf to for example
> 100sec:
> 
> diff --git a/bitbake/lib/bb/fetch2/wget.py b/bitbake/lib/bb/fetch2/wget.py
> --- a/bitbake/lib/bb/fetch2/wget.py
> +++ b/bitbake/lib/bb/fetch2/wget.py
> @@ -58,7 +58,7 @@ class Wget(FetchMethod):
> 
>          ud.localfile = data.expand(urllib.unquote(ud.basename), d)
> 
> -        self.basecmd = d.getVar("FETCHCMD_wget", True) or "/usr/bin/env
> wget -t 2 -T 30 -nv --passive-ftp --no-check-certificate"
> +        self.basecmd = d.getVar("FETCHCMD_wget", True) or "/usr/bin/env
> wget -t 2 -T 100 -nv --passive-ftp --no-check-certificate"
> 
>      def _runwget(self, ud, d, command, quiet):
> 
> diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
> --- a/meta/conf/bitbake.conf
> +++ b/meta/conf/bitbake.conf
> @@ -575,7 +575,7 @@ XORG_MIRROR =
> "http://xorg.freedesktop.org/releases"
> 
>  FETCHCMD_svn = "/usr/bin/env svn --non-interactive --trust-server-cert"
>  FETCHCMD_cvs = "/usr/bin/env cvs"
> -FETCHCMD_wget = "/usr/bin/env wget -t 2 -T 30 -nv --passive-ftp --no-
> check-certificate"
> +FETCHCMD_wget = "/usr/bin/env wget -t 2 -T 100 -nv --passive-ftp
> --no-check-certificate"
>  FETCHCMD_bzr = "/usr/bin/env bzr"
>  FETCHCMD_hg = "/usr/bin/env hg"
> 
> 
> hope that helps!
> 
> best regards,
> Richard L

Hi Richard,

I tried increasing the wget duration from 30 seconds to 100 seconds as you suggested. I'm still facing the timeout issue. 
This is what I get when I execute $ bitbake -v openjdk-7-jre : 


ln -sf /home/ilab/dev/build/poky/build/tmp/work/core2-32-poky-linux/openjdk-7-jre/85b01-2.6.1-r6.1/39b2c4354d0a.tar.bz2 openjdk.tar.bz2

if ! echo "0168a0174ee47407139ee32458c4d2a298ba4f44260343b209250156e4da463f  openjdk.tar.bz2" \
          | /usr/bin/sha256sum --check ; \
        then \
          if test "xyes" = "xyes"; then \
            if [ -e openjdk.tar.bz2 ] ; then \
              mv openjdk.tar.bz2 openjdk.tar.bz2.old ; \
            fi ; \
            /usr/bin/wget http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar.bz2; \
            if ! echo "0168a0174ee47407139ee32458c4d2a298ba4f44260343b209250156e4da463f  openjdk.tar.bz2" \
              | /usr/bin/sha256sum --check ; then \
              echo "ERROR: Bad download of OpenJDK root zip"; false; \
            fi; \
          else \
            echo "ERROR: No up-to-date OpenJDK root zip available"; exit -1; \
          fi ; \
        fi ;

openjdk.tar.bz2: FAILED
/usr/bin/sha256sum: WARNING: 1 computed checksum did NOT match

--2015-10-06 16:48:07--  http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar.bz2

Resolving icedtea.classpath.org (icedtea.classpath.org)...
208.78.240.231

Connecting to icedtea.classpath.org (icedtea.classpath.org)|208.78.240.231|:80...
failed: Connection timed out.

Regards,
RAJ

Re: [meta-java] openjdk: openjdk.tar.bz2 download time out due to sha256sum mismatch.

[Ramajayam, Yugeraj]

> -----Original Message-----
> From: Ramajayam, Yugeraj
> Sent: Tuesday, October 6, 2015 4:55 PM
> To: Richard Leitner <richard.leitner@skidata.com>; openembedded-
> devel@lists.openembedded.org
> Cc: Sven Ebenfeld <sven.ebenfeld@gmail.com>
> Subject: RE: [meta-java] openjdk: openjdk.tar.bz2 download time out due to
> sha256sum mismatch.
> 
> > -----Original Message-----
> > From: Richard Leitner [mailto:richard.leitner@skidata.com]
> > Sent: Tuesday, September 29, 2015 7:40 PM
> > To: openembedded-devel@lists.openembedded.org
> > Cc: Ramajayam, Yugeraj <yugeraj.ramajayam@intel.com>; Sven Ebenfeld
> > <sven.ebenfeld@gmail.com>
> > Subject: Re: [meta-java] openjdk: openjdk.tar.bz2 download time out
> > due to sha256sum mismatch.
> >
> > On 09/25/2015 11:25 AM, Ramajayam, Yugeraj wrote:
> > > Hi all,
> > >
> > > I am trying to include java support for valleyisland-64 bsp.
> > >
> > > I have followed all the Usage Instructions as mentioned in the
> > > meta-java About page.
> > >
> > Your configuration looks fine!
> >
> > >
> > > When I execute $ bitbake core-image-sato , I am having following
> > > error due to openjdk.tar.bz2 time out issue.
> > >
> > > When I try to wget manually, the tar ball was downloaded fine and
> > > the md5sum and sha256sum matches accordingly.
> > >
> > > The error message appears as below :
> > ...
> > >
> > > *openjdk.tar.bz2: FAILED*
> > > */usr/bin/sha256sum: WARNING: 1 computed checksum did NOT match*
> > > * *
> > > *--2015-09-25 17:00:34--
> > > http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.t
> > > ar
> > > .bz2*
> > > * *
> > > *Resolving icedtea.classpath.org (icedtea.classpath.org)...*
> > > *208.78.240.231*
> > > * *
> > > *Connecting to icedtea.classpath.org
> > > (icedtea.classpath.org)|208.78.240.231|:80...*
> > > *failed: Connection timed out.*
> > > * *
> > > *Retrying.*
> >
> > IMHO it looks like the wget falls into a timeout. How long does the
> "manual"
> > wget download take?
> >
> > You could try to increase the wget timeout in
> > bitbake/lib/bb/fetch2/wget.py and meta/conf/bitbake.conf to for
> > example
> > 100sec:
> >
> > diff --git a/bitbake/lib/bb/fetch2/wget.py
> > b/bitbake/lib/bb/fetch2/wget.py
> > --- a/bitbake/lib/bb/fetch2/wget.py
> > +++ b/bitbake/lib/bb/fetch2/wget.py
> > @@ -58,7 +58,7 @@ class Wget(FetchMethod):
> >
> >          ud.localfile = data.expand(urllib.unquote(ud.basename), d)
> >
> > -        self.basecmd = d.getVar("FETCHCMD_wget", True) or "/usr/bin/env
> > wget -t 2 -T 30 -nv --passive-ftp --no-check-certificate"
> > +        self.basecmd = d.getVar("FETCHCMD_wget", True) or
> > + "/usr/bin/env
> > wget -t 2 -T 100 -nv --passive-ftp --no-check-certificate"
> >
> >      def _runwget(self, ud, d, command, quiet):
> >
> > diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
> > --- a/meta/conf/bitbake.conf
> > +++ b/meta/conf/bitbake.conf
> > @@ -575,7 +575,7 @@ XORG_MIRROR =
> > "http://xorg.freedesktop.org/releases"
> >
> >  FETCHCMD_svn = "/usr/bin/env svn --non-interactive --trust-server-cert"
> >  FETCHCMD_cvs = "/usr/bin/env cvs"
> > -FETCHCMD_wget = "/usr/bin/env wget -t 2 -T 30 -nv --passive-ftp --no-
> > check-certificate"
> > +FETCHCMD_wget = "/usr/bin/env wget -t 2 -T 100 -nv --passive-ftp
> > --no-check-certificate"
> >  FETCHCMD_bzr = "/usr/bin/env bzr"
> >  FETCHCMD_hg = "/usr/bin/env hg"
> >
> >
> > hope that helps!
> >
> > best regards,
> > Richard L
> 
> Hi Richard,
> 
> I tried increasing the wget duration from 30 seconds to 100 seconds as you
> suggested. I'm still facing the timeout issue.
> This is what I get when I execute $ bitbake -v openjdk-7-jre :
> 
> 
> ln -sf /home/ilab/dev/build/poky/build/tmp/work/core2-32-poky-
> linux/openjdk-7-jre/85b01-2.6.1-r6.1/39b2c4354d0a.tar.bz2 openjdk.tar.bz2
> 
> if ! echo
> "0168a0174ee47407139ee32458c4d2a298ba4f44260343b209250156e4da463
> f  openjdk.tar.bz2" \
>           | /usr/bin/sha256sum --check ; \
>         then \
>           if test "xyes" = "xyes"; then \
>             if [ -e openjdk.tar.bz2 ] ; then \
>               mv openjdk.tar.bz2 openjdk.tar.bz2.old ; \
>             fi ; \
>             /usr/bin/wget
> http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar.bz
> 2; \
>             if ! echo
> "0168a0174ee47407139ee32458c4d2a298ba4f44260343b209250156e4da463
> f  openjdk.tar.bz2" \
>               | /usr/bin/sha256sum --check ; then \
>               echo "ERROR: Bad download of OpenJDK root zip"; false; \
>             fi; \
>           else \
>             echo "ERROR: No up-to-date OpenJDK root zip available"; exit -1; \
>           fi ; \
>         fi ;
> 
> openjdk.tar.bz2: FAILED
> /usr/bin/sha256sum: WARNING: 1 computed checksum did NOT match
> 
> --2015-10-06 16:48:07--
> http://icedtea.classpath.org/download/drops/icedtea7/2.6.1/openjdk.tar.bz
> 2
> 
> Resolving icedtea.classpath.org (icedtea.classpath.org)...
> 208.78.240.231
> 
> Connecting to icedtea.classpath.org
> (icedtea.classpath.org)|208.78.240.231|:80...
> failed: Connection timed out.
> 
> Regards,
> RAJ

Hi Richard,

An update to my attempt to build the latest java, 
although I attempt to build from the latest version from meta-java, I am facing the timeout issue.
I followed your advice to increase the bitbake time from 30 to 100 seconds, still no success.
Below are the ERROR message that I received. Please suggest me if there is anything else I can do.

 --2015-10-30 13:16:43--  (try:20)  http://icedtea.classpath.org/download/drops/icedtea7/2.6.2/openjdk.tar.bz2
 Connecting to icedtea.classpath.org (icedtea.classpath.org)|208.78.240.231|:80... failed: Connection timed out.
 Giving up.

 /usr/bin/sha256sum: openjdk.tar.bz2: No such file or directory
 openjdk.tar.bz2: FAILED open or read
 /usr/bin/sha256sum: WARNING: 1 listed file could not be read
 ERROR: Bad download of OpenJDK root zip
 make: *** [stamps/download-openjdk.stamp] Error 1
 ERROR: oe_runmake failed