Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Martin Jansa <martin.jansa@gmail.com>]

[-- Attachment #1: Type: text/plain, Size: 6622 bytes --]

On Tue, Nov 13, 2018 at 03:27:39PM -0800, akuster808 wrote:
> 
> On 11/13/18 2:55 PM, Martin Jansa wrote:
> > Is this the right URL? http://sources.openembedded.org/mirror/sources/
> > returns 404
> 
> I thought it was.
> 
> I get 404 with http://sources.openembedded.org/
> <http://sources.openembedded.org/mirror/sources/>

This link is http://sources.openembedded.org/mirror/sources/, that's why
it's 404, with http://sources.openembedded.org/ you get 403, which is
fine.
> 
> >
> > meta/classes/mirrors.bbclass also uses:
> > cvs://.*/.*     http://sources.openembedded.org/ \n \
> > svn://.*/.*     http://sources.openembedded.org/ \n \
> > git://.*/.*     http://sources.openembedded.org/ \n \
> > hg://.*/.*      http://sources.openembedded.org/ \n \
> > bzr://.*/.*     http://sources.openembedded.org/ \n \
> > p4://.*/.*      http://sources.openembedded.org/ \n \
> > osc://.*/.*     http://sources.openembedded.org/ \n \
> > https?$://.*/.* http://sources.openembedded.org/ \n \
> > ftp://.*/.*     http://sources.openembedded.org/ \n \
> > npm://.*/?.*    http://sources.openembedded.org/ \n \
> >
> I will change the URL's. thanks.
> > without the /mirror/sources suffix, maybe it's copy & paste issue from
> > downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
> > uses /mirror/sources?
> > git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
> >
> > But if the test works for you, then something even worse is going on :).
> 
> 
> it found:
> 
> Summary: 5 tasks failed:
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
> 
> with url changes i see:
> 
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
> 
> maybe the OE system needs to be checked out.

I've checked it yesterday and it's broken since Aug 6.

See IRC log from earlier today:
00:14 < armpit> sources.openembedded.org needs updating ; )
00:17 < JaMa> armpit: khem: the builder lost access to the fileserver as shown in
http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/475/console
00:18 < JaMa> something changed between Aug 6th and 9th

> 
> 
> - armin
> 
> >
> > On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com
> > <mailto:akuster808@gmail.com>> wrote:
> >
> >     Signed-off-by: Armin Kuster <akuster808@gmail.com
> >     <mailto:akuster808@gmail.com>>
> >     ---
> >      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
> >     ++++++++++++++++++++++
> >      1 file changed, 30 insertions(+)
> >      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >
> >     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     new file mode 100644
> >     index 0000000..79bebf5
> >     --- /dev/null
> >     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     @@ -0,0 +1,30 @@
> >     +import os
> >     +import re
> >     +import glob as g
> >     +import shutil
> >     +import tempfile
> >     +from oeqa.selftest.case import OESelftestTestCase
> >     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
> >     get_bb_vars
> >     +
> >     +class MetaOESourceMirroring(OESelftestTestCase):
> >     +    # Can we download everything from the OpenEmbedded Sources
> >     Mirror over http only
> >     +    def test_oe_source_mirror(self):
> >     +        self.write_config("""
> >     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
> >     <http://sources.openembedded.org>"
> >     +MIRRORS = ""
> >     +DL_DIR = "${TMPDIR}/test_oe_downloads"
> >     +PREMIRRORS = "\\
> >     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    ftp://.*/.*     
> >     http://sources.openembedded.org/mirror/sources/ \\n \\
> >     +    http://.*/.*   
> >      http://sources.openembedded.org/mirror/sources/ \\n \\
> >     +    https://.*/.*   
> >     http://sources.openembedded.org/mirror/sources/ \\n"
> >     +    """)
> >     +
> >     +        bitbake("world --runall fetch")
> >     -- 
> >     2.7.4
> >
> >     -- 
> >     _______________________________________________
> >     Openembedded-devel mailing list
> >     Openembedded-devel@lists.openembedded.org
> >     <mailto:Openembedded-devel@lists.openembedded.org>
> >     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> >

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 201 bytes --]