[meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Armin Kuster]

Signed-off-by: Armin Kuster <akuster808@gmail.com>
---
 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30 ++++++++++++++++++++++
 1 file changed, 30 insertions(+)
 create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py

diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
new file mode 100644
index 0000000..79bebf5
--- /dev/null
+++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
@@ -0,0 +1,30 @@
+import os
+import re
+import glob as g
+import shutil
+import tempfile
+from oeqa.selftest.case import OESelftestTestCase
+from oeqa.utils.commands import runCmd, bitbake, get_bb_var, get_bb_vars
+
+class MetaOESourceMirroring(OESelftestTestCase):
+    # Can we download everything from the OpenEmbedded Sources Mirror over http only
+    def test_oe_source_mirror(self):
+        self.write_config("""
+BB_ALLOWED_NETWORKS = " sources.openembedded.org"
+MIRRORS = ""
+DL_DIR = "${TMPDIR}/test_oe_downloads"
+PREMIRRORS = "\\
+    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    git://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/ \\n \\
+    hg://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
+    osc://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    p4://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
+    svn://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
+    ftp://.*/.*      http://sources.openembedded.org/mirror/sources/ \\n \\
+    http://.*/.*     http://sources.openembedded.org/mirror/sources/ \\n \\
+    https://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n"
+    """)
+
+        bitbake("world --runall fetch")
-- 
2.7.4

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Martin Jansa]

Is this the right URL? http://sources.openembedded.org/mirror/sources/
returns 404

meta/classes/mirrors.bbclass also uses:
cvs://.*/.*     http://sources.openembedded.org/ \n \
svn://.*/.*     http://sources.openembedded.org/ \n \
git://.*/.*     http://sources.openembedded.org/ \n \
hg://.*/.*      http://sources.openembedded.org/ \n \
bzr://.*/.*     http://sources.openembedded.org/ \n \
p4://.*/.*      http://sources.openembedded.org/ \n \
osc://.*/.*     http://sources.openembedded.org/ \n \
https?$://.*/.* http://sources.openembedded.org/ \n \
ftp://.*/.*     http://sources.openembedded.org/ \n \
npm://.*/?.*    http://sources.openembedded.org/ \n \

without the /mirror/sources suffix, maybe it's copy & paste issue from
downloads.yoctoproject.org which uses /mirror/sources?
git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \

But if the test works for you, then something even worse is going on :).

On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com> wrote:

> Signed-off-by: Armin Kuster <akuster808@gmail.com>
> ---
>  meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
> ++++++++++++++++++++++
>  1 file changed, 30 insertions(+)
>  create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>
> diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> new file mode 100644
> index 0000000..79bebf5
> --- /dev/null
> +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> @@ -0,0 +1,30 @@
> +import os
> +import re
> +import glob as g
> +import shutil
> +import tempfile
> +from oeqa.selftest.case import OESelftestTestCase
> +from oeqa.utils.commands import runCmd, bitbake, get_bb_var, get_bb_vars
> +
> +class MetaOESourceMirroring(OESelftestTestCase):
> +    # Can we download everything from the OpenEmbedded Sources Mirror
> over http only
> +    def test_oe_source_mirror(self):
> +        self.write_config("""
> +BB_ALLOWED_NETWORKS = " sources.openembedded.org"
> +MIRRORS = ""
> +DL_DIR = "${TMPDIR}/test_oe_downloads"
> +PREMIRRORS = "\\
> +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    git://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/ \\n \\
> +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
> +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n \\
> +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/ \\n \\
> +    ftp://.*/.*      http://sources.openembedded.org/mirror/sources/ \\n
> \\
> +    http://.*/.*     http://sources.openembedded.org/mirror/sources/ \\n
> \\
> +    https://.*/.*    http://sources.openembedded.org/mirror/sources/ \\n"
> +    """)
> +
> +        bitbake("world --runall fetch")
> --
> 2.7.4
>
> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[akuster808]

On 11/13/18 2:55 PM, Martin Jansa wrote:
> Is this the right URL? http://sources.openembedded.org/mirror/sources/
> returns 404

I thought it was.

I get 404 with http://sources.openembedded.org/
<http://sources.openembedded.org/mirror/sources/>

>
> meta/classes/mirrors.bbclass also uses:
> cvs://.*/.*     http://sources.openembedded.org/ \n \
> svn://.*/.*     http://sources.openembedded.org/ \n \
> git://.*/.*     http://sources.openembedded.org/ \n \
> hg://.*/.*      http://sources.openembedded.org/ \n \
> bzr://.*/.*     http://sources.openembedded.org/ \n \
> p4://.*/.*      http://sources.openembedded.org/ \n \
> osc://.*/.*     http://sources.openembedded.org/ \n \
> https?$://.*/.* http://sources.openembedded.org/ \n \
> ftp://.*/.*     http://sources.openembedded.org/ \n \
> npm://.*/?.*    http://sources.openembedded.org/ \n \
>
I will change the URL's. thanks.
> without the /mirror/sources suffix, maybe it's copy & paste issue from
> downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
> uses /mirror/sources?
> git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
>
> But if the test works for you, then something even worse is going on :).


it found:

Summary: 5 tasks failed:
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch

with url changes i see:

virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
 
virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch

maybe the OE system needs to be checked out.


- armin

>
> On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com
> <mailto:akuster808@gmail.com>> wrote:
>
>     Signed-off-by: Armin Kuster <akuster808@gmail.com
>     <mailto:akuster808@gmail.com>>
>     ---
>      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
>     ++++++++++++++++++++++
>      1 file changed, 30 insertions(+)
>      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>
>     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>     new file mode 100644
>     index 0000000..79bebf5
>     --- /dev/null
>     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>     @@ -0,0 +1,30 @@
>     +import os
>     +import re
>     +import glob as g
>     +import shutil
>     +import tempfile
>     +from oeqa.selftest.case import OESelftestTestCase
>     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
>     get_bb_vars
>     +
>     +class MetaOESourceMirroring(OESelftestTestCase):
>     +    # Can we download everything from the OpenEmbedded Sources
>     Mirror over http only
>     +    def test_oe_source_mirror(self):
>     +        self.write_config("""
>     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
>     <http://sources.openembedded.org>"
>     +MIRRORS = ""
>     +DL_DIR = "${TMPDIR}/test_oe_downloads"
>     +PREMIRRORS = "\\
>     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
>     \\n \\
>     +    ftp://.*/.*     
>     http://sources.openembedded.org/mirror/sources/ \\n \\
>     +    http://.*/.*   
>      http://sources.openembedded.org/mirror/sources/ \\n \\
>     +    https://.*/.*   
>     http://sources.openembedded.org/mirror/sources/ \\n"
>     +    """)
>     +
>     +        bitbake("world --runall fetch")
>     -- 
>     2.7.4
>
>     -- 
>     _______________________________________________
>     Openembedded-devel mailing list
>     Openembedded-devel@lists.openembedded.org
>     <mailto:Openembedded-devel@lists.openembedded.org>
>     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Martin Jansa]

[-- Attachment #1: Type: text/plain, Size: 6622 bytes --]

On Tue, Nov 13, 2018 at 03:27:39PM -0800, akuster808 wrote:
> 
> On 11/13/18 2:55 PM, Martin Jansa wrote:
> > Is this the right URL? http://sources.openembedded.org/mirror/sources/
> > returns 404
> 
> I thought it was.
> 
> I get 404 with http://sources.openembedded.org/
> <http://sources.openembedded.org/mirror/sources/>

This link is http://sources.openembedded.org/mirror/sources/, that's why
it's 404, with http://sources.openembedded.org/ you get 403, which is
fine.
> 
> >
> > meta/classes/mirrors.bbclass also uses:
> > cvs://.*/.*     http://sources.openembedded.org/ \n \
> > svn://.*/.*     http://sources.openembedded.org/ \n \
> > git://.*/.*     http://sources.openembedded.org/ \n \
> > hg://.*/.*      http://sources.openembedded.org/ \n \
> > bzr://.*/.*     http://sources.openembedded.org/ \n \
> > p4://.*/.*      http://sources.openembedded.org/ \n \
> > osc://.*/.*     http://sources.openembedded.org/ \n \
> > https?$://.*/.* http://sources.openembedded.org/ \n \
> > ftp://.*/.*     http://sources.openembedded.org/ \n \
> > npm://.*/?.*    http://sources.openembedded.org/ \n \
> >
> I will change the URL's. thanks.
> > without the /mirror/sources suffix, maybe it's copy & paste issue from
> > downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
> > uses /mirror/sources?
> > git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
> >
> > But if the test works for you, then something even worse is going on :).
> 
> 
> it found:
> 
> Summary: 5 tasks failed:
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
> 
> with url changes i see:
> 
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>  
> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
> 
> maybe the OE system needs to be checked out.

I've checked it yesterday and it's broken since Aug 6.

See IRC log from earlier today:
00:14 < armpit> sources.openembedded.org needs updating ; )
00:17 < JaMa> armpit: khem: the builder lost access to the fileserver as shown in
http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/475/console
00:18 < JaMa> something changed between Aug 6th and 9th

> 
> 
> - armin
> 
> >
> > On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com
> > <mailto:akuster808@gmail.com>> wrote:
> >
> >     Signed-off-by: Armin Kuster <akuster808@gmail.com
> >     <mailto:akuster808@gmail.com>>
> >     ---
> >      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
> >     ++++++++++++++++++++++
> >      1 file changed, 30 insertions(+)
> >      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >
> >     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     new file mode 100644
> >     index 0000000..79bebf5
> >     --- /dev/null
> >     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
> >     @@ -0,0 +1,30 @@
> >     +import os
> >     +import re
> >     +import glob as g
> >     +import shutil
> >     +import tempfile
> >     +from oeqa.selftest.case import OESelftestTestCase
> >     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
> >     get_bb_vars
> >     +
> >     +class MetaOESourceMirroring(OESelftestTestCase):
> >     +    # Can we download everything from the OpenEmbedded Sources
> >     Mirror over http only
> >     +    def test_oe_source_mirror(self):
> >     +        self.write_config("""
> >     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
> >     <http://sources.openembedded.org>"
> >     +MIRRORS = ""
> >     +DL_DIR = "${TMPDIR}/test_oe_downloads"
> >     +PREMIRRORS = "\\
> >     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
> >     \\n \\
> >     +    ftp://.*/.*     
> >     http://sources.openembedded.org/mirror/sources/ \\n \\
> >     +    http://.*/.*   
> >      http://sources.openembedded.org/mirror/sources/ \\n \\
> >     +    https://.*/.*   
> >     http://sources.openembedded.org/mirror/sources/ \\n"
> >     +    """)
> >     +
> >     +        bitbake("world --runall fetch")
> >     -- 
> >     2.7.4
> >
> >     -- 
> >     _______________________________________________
> >     Openembedded-devel mailing list
> >     Openembedded-devel@lists.openembedded.org
> >     <mailto:Openembedded-devel@lists.openembedded.org>
> >     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> >

-- 
Martin 'JaMa' Jansa     jabber: Martin.Jansa@gmail.com

[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 201 bytes --]

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[akuster808]

[-- Attachment #1.1.1: Type: text/plain, Size: 6719 bytes --]


On 11/14/18 7:17 AM, Martin Jansa wrote:
> On Tue, Nov 13, 2018 at 03:27:39PM -0800, akuster808 wrote:
>> On 11/13/18 2:55 PM, Martin Jansa wrote:
>>> Is this the right URL? http://sources.openembedded.org/mirror/sources/
>>> returns 404
>> I thought it was.
>>
>> I get 404 with http://sources.openembedded.org/
>> <http://sources.openembedded.org/mirror/sources/>
> This link is http://sources.openembedded.org/mirror/sources/, that's why
> it's 404, with http://sources.openembedded.org/ you get 403, which is
> fine.
>>> meta/classes/mirrors.bbclass also uses:
>>> cvs://.*/.*     http://sources.openembedded.org/ \n \
>>> svn://.*/.*     http://sources.openembedded.org/ \n \
>>> git://.*/.*     http://sources.openembedded.org/ \n \
>>> hg://.*/.*      http://sources.openembedded.org/ \n \
>>> bzr://.*/.*     http://sources.openembedded.org/ \n \
>>> p4://.*/.*      http://sources.openembedded.org/ \n \
>>> osc://.*/.*     http://sources.openembedded.org/ \n \
>>> https?$://.*/.* http://sources.openembedded.org/ \n \
>>> ftp://.*/.*     http://sources.openembedded.org/ \n \
>>> npm://.*/?.*    http://sources.openembedded.org/ \n \
>>>
>> I will change the URL's. thanks.
>>> without the /mirror/sources suffix, maybe it's copy & paste issue from
>>> downloads.yoctoproject.org <http://downloads.yoctoproject.org> which
>>> uses /mirror/sources?
>>> git://.*/.*     http://downloads.yoctoproject.org/mirror/sources/ \n \
>>>
>>> But if the test works for you, then something even worse is going on :).
>>
>> it found:
>>
>> Summary: 5 tasks failed:
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
>>
>> with url changes i see:
>>
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/jpeg/libjpeg-turbo_2.0.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-graphics/pango/pango_1.42.4.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/elfutils/elfutils_0.174.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-extended/libarchive/libarchive_3.3.3.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-support/mpfr/mpfr_4.0.1.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-kernel/dtc/dtc_1.4.7.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/meta-openembedded/meta-networking/recipes-support/c-ares/c-ares_1.14.0.bb:do_fetch
>>  
>> virtual:native:/home/akuster/OE/master/openembedded-core/meta/recipes-devtools/binutils/binutils_2.31.bb:do_fetch
>>
>> maybe the OE system needs to be checked out.
> I've checked it yesterday and it's broken since Aug 6.
>
> See IRC log from earlier today:
> 00:14 < armpit> sources.openembedded.org needs updating ; )
> 00:17 < JaMa> armpit: khem: the builder lost access to the fileserver as shown in
> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/475/console
> 00:18 < JaMa> something changed between Aug 6th and 9th
>

/I think Khem is looking into it./

/Looks like the selftest has a use./

/- armin/

>>
>> - armin
>>
>>> On Tue, Nov 13, 2018 at 11:40 PM Armin Kuster <akuster808@gmail.com
>>> <mailto:akuster808@gmail.com>> wrote:
>>>
>>>     Signed-off-by: Armin Kuster <akuster808@gmail.com
>>>     <mailto:akuster808@gmail.com>>
>>>     ---
>>>      meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py | 30
>>>     ++++++++++++++++++++++
>>>      1 file changed, 30 insertions(+)
>>>      create mode 100644 meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>
>>>     diff --git a/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     new file mode 100644
>>>     index 0000000..79bebf5
>>>     --- /dev/null
>>>     +++ b/meta-oe/lib/oeqa/selftest/cases/meta_oe_sources.py
>>>     @@ -0,0 +1,30 @@
>>>     +import os
>>>     +import re
>>>     +import glob as g
>>>     +import shutil
>>>     +import tempfile
>>>     +from oeqa.selftest.case import OESelftestTestCase
>>>     +from oeqa.utils.commands import runCmd, bitbake, get_bb_var,
>>>     get_bb_vars
>>>     +
>>>     +class MetaOESourceMirroring(OESelftestTestCase):
>>>     +    # Can we download everything from the OpenEmbedded Sources
>>>     Mirror over http only
>>>     +    def test_oe_source_mirror(self):
>>>     +        self.write_config("""
>>>     +BB_ALLOWED_NETWORKS = " sources.openembedded.org
>>>     <http://sources.openembedded.org>"
>>>     +MIRRORS = ""
>>>     +DL_DIR = "${TMPDIR}/test_oe_downloads"
>>>     +PREMIRRORS = "\\
>>>     +    bzr://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    cvs://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    git://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    gitsm://.*/.* http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    hg://.*/.*    http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    osc://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    p4://.*/.*    http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    svn://.*/.*   http://sources.openembedded.org/mirror/sources/
>>>     \\n \\
>>>     +    ftp://.*/.*     
>>>     http://sources.openembedded.org/mirror/sources/ \\n \\
>>>     +    http://.*/.*   
>>>      http://sources.openembedded.org/mirror/sources/ \\n \\
>>>     +    https://.*/.*   
>>>     http://sources.openembedded.org/mirror/sources/ \\n"
>>>     +    """)
>>>     +
>>>     +        bitbake("world --runall fetch")
>>>     -- 
>>>     2.7.4
>>>
>>>     -- 
>>>     _______________________________________________
>>>     Openembedded-devel mailing list
>>>     Openembedded-devel@lists.openembedded.org
>>>     <mailto:Openembedded-devel@lists.openembedded.org>
>>>     http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 836 bytes --]

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Michael Halstead]

The rsync target on on the world build machine was offline following a
reboot causing the sync to sources.oe.org to fail. The rsync target is now
configured to be available following reboots and the sync has run. Please
let me know if this test still fails.

On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com> wrote:

> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Khem Raj]

Thanks Michael for taking care of it

On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
mhalstead@linuxfoundation.org> wrote:

> The rsync target on on the world build machine was offline following a
> reboot causing the sync to sources.oe.org to fail. The rsync target is now
> configured to be available following reboots and the sync has run. Please
> let me know if this test still fails.
>
> On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com> wrote:
>
> > --
> > _______________________________________________
> > Openembedded-devel mailing list
> > Openembedded-devel@lists.openembedded.org
> > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> >
> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Martin Jansa]

The jenkins job which does the rsync (or at least how I was doing it), is
still failing as reported before:
http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/480/console

Either you're using something else now, or it still won't work.

Regards,

On Mon, Nov 19, 2018 at 9:18 PM Khem Raj <raj.khem@gmail.com> wrote:

> Thanks Michael for taking care of it
>
> On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
> mhalstead@linuxfoundation.org> wrote:
>
> > The rsync target on on the world build machine was offline following a
> > reboot causing the sync to sources.oe.org to fail. The rsync target is
> now
> > configured to be available following reboots and the sync has run. Please
> > let me know if this test still fails.
> >
> > On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com> wrote:
> >
> > > --
> > > _______________________________________________
> > > Openembedded-devel mailing list
> > > Openembedded-devel@lists.openembedded.org
> > > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> > >
> > --
> > _______________________________________________
> > Openembedded-devel mailing list
> > Openembedded-devel@lists.openembedded.org
> > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
> >
> --
> _______________________________________________
> Openembedded-devel mailing list
> Openembedded-devel@lists.openembedded.org
> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[Martin Jansa]

I've fixed known_hosts on abaco and some archives were finally rsynced:
http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/481/console

but it doesn't seem to cover all found issues, please re-run the test to
see what's left.


On Tue, Nov 20, 2018 at 9:07 AM Martin Jansa <martin.jansa@gmail.com> wrote:

> The jenkins job which does the rsync (or at least how I was doing it), is
> still failing as reported before:
>
> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/480/console
>
> Either you're using something else now, or it still won't work.
>
> Regards,
>
> On Mon, Nov 19, 2018 at 9:18 PM Khem Raj <raj.khem@gmail.com> wrote:
>
>> Thanks Michael for taking care of it
>>
>> On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
>> mhalstead@linuxfoundation.org> wrote:
>>
>> > The rsync target on on the world build machine was offline following a
>> > reboot causing the sync to sources.oe.org to fail. The rsync target is
>> now
>> > configured to be available following reboots and the sync has run.
>> Please
>> > let me know if this test still fails.
>> >
>> > On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com>
>> wrote:
>> >
>> > > --
>> > > _______________________________________________
>> > > Openembedded-devel mailing list
>> > > Openembedded-devel@lists.openembedded.org
>> > > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>> > >
>> > --
>> > _______________________________________________
>> > Openembedded-devel mailing list
>> > Openembedded-devel@lists.openembedded.org
>> > http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>> >
>> --
>> _______________________________________________
>> Openembedded-devel mailing list
>> Openembedded-devel@lists.openembedded.org
>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>
>

Re: [meta-oe][PATCH] meta-oe: add selftest for sources.oe.org

[akuster808]

Thanks Martin,

Looks like this is the only failure left.

Summary: 1 task failed:
 
virtual:native:/home/build/releases/master/openembedded-core/meta/recipes-support/lz4/lz4_1.8.2.bb:do_fetch

- Armin



On 11/21/18 7:18 AM, Martin Jansa wrote:
> I've fixed known_hosts on abaco and some archives were finally rsynced:
> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/481/console
>
> but it doesn't seem to cover all found issues, please re-run the test to
> see what's left.
>
>
> On Tue, Nov 20, 2018 at 9:07 AM Martin Jansa <martin.jansa@gmail.com> wrote:
>
>> The jenkins job which does the rsync (or at least how I was doing it), is
>> still failing as reported before:
>>
>> http://jenkins.nas-admin.org/view/OE/job/oe_world_workspace-rsync/480/console
>>
>> Either you're using something else now, or it still won't work.
>>
>> Regards,
>>
>> On Mon, Nov 19, 2018 at 9:18 PM Khem Raj <raj.khem@gmail.com> wrote:
>>
>>> Thanks Michael for taking care of it
>>>
>>> On Mon, Nov 19, 2018 at 12:02 PM Michael Halstead <
>>> mhalstead@linuxfoundation.org> wrote:
>>>
>>>> The rsync target on on the world build machine was offline following a
>>>> reboot causing the sync to sources.oe.org to fail. The rsync target is
>>> now
>>>> configured to be available following reboots and the sync has run.
>>> Please
>>>> let me know if this test still fails.
>>>>
>>>> On Wed, Nov 14, 2018 at 8:19 AM akuster808 <akuster808@gmail.com>
>>> wrote:
>>>>> --
>>>>> _______________________________________________
>>>>> Openembedded-devel mailing list
>>>>> Openembedded-devel@lists.openembedded.org
>>>>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>>>
>>>> --
>>>> _______________________________________________
>>>> Openembedded-devel mailing list
>>>> Openembedded-devel@lists.openembedded.org
>>>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>>
>>> --
>>> _______________________________________________
>>> Openembedded-devel mailing list
>>> Openembedded-devel@lists.openembedded.org
>>> http://lists.openembedded.org/mailman/listinfo/openembedded-devel
>>>