[RFC] DISTRO_MIRRORS / DISTRO_PREMIRRORS

[Saul Wold <sgw@linux.intel.com>]

Folks,

Recently we have seen a number of fetch failures, due to upstream sites 
being down or deprecated (tinylogin, pscmic and others).

The issue is that oe-core as a non-distro does not have a default set of 
mirrors, which causes the fetcher to fail as there is no fall-back 
mirror to distrubte the source code.

As has been pointed out, different projects and distributions (Yocto 
Project and Angstrom) both have upstream source mirrors which could be 
used. Currently the Yocto Project defines it's MIRRORS and PREMIRRORS in 
meta-yocto/conf/distro/poky.conf.

I propose that we add a list of DISTO_MIRRORS and DISTRO_PREMIRRORS with 
default settings pointing to the current autobuilder.yoctoproject.org 
source site.  These would be added to the mirrors.bbclass, so that 
oe-core will have a default set of mirrors that can be overridden by a 
distro or layer.

diff --git a/meta/classes/mirrors.bbclass b/meta/classes/mirrors.bbclass
index 2146087..a52c6d5 100644
--- a/meta/classes/mirrors.bbclass
+++ b/meta/classes/mirrors.bbclass
@@ -1,4 +1,22 @@
+DISTRO_PREMIRRORS ?= "\
+bzr://.*/.*   http://autobuilder.yoctoproject.org/sources/ \n \
+cvs://.*/.*   http://autobuilder.yoctoproject.org/sources/ \n \
+git://.*/.*   http://autobuilder.yoctoproject.org/sources/ \n \
+hg://.*/.*    http://autobuilder.yoctoproject.org/sources/ \n \
+osc://.*/.*   http://autobuilder.yoctoproject.org/sources/ \n \
+p4://.*/.*    http://autobuilder.yoctoproject.org/sources/ \n \
+svk://.*/.*   http://autobuilder.yoctoproject.org/sources/ \n \
+svn://.*/.*   http://autobuilder.yoctoproject.org/sources/ \n"
+
+PREMIRRORS += "${DISTRO_PREMIRRORS}"
+
+DISTRO_MIRRORS ?= "\
+ftp://.*/.*      http://autobuilder.yoctoproject.org/sources/ \n \
+http://.*/.*     http://autobuilder.yoctoproject.org/sources/ \n \
+https://.*/.*    http://autobuilder.yoctoproject.org/sources/ \n"
+
  MIRRORS += "\
+${DISTRO_MIRRORS} \
  ${DEBIAN_MIRROR}/main  http://snapshot.debian.net/archive/pool \n \
  ${DEBIAN_MIRROR}       ftp://ftp.de.debian.org/debian/pool \n \
  ${DEBIAN_MIRROR}       ftp://ftp.au.debian.org/debian/pool \n \

Thoughts, ACKs, NAKs??


--
     Sau!

Saul Wold
Yocto Component Wrangler @ Intel
Yocto Project / Poky Build System