* [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy @ 2015-01-30 16:51 Viguera, Javier 2015-01-30 17:23 ` Paul Eggleton 0 siblings, 1 reply; 15+ messages in thread From: Viguera, Javier @ 2015-01-30 16:51 UTC (permalink / raw) To: 'openembedded-devel@lists.openembedded.org' Hi all, Seems that CRDA maintainers did some changes that broke the fetch of the package for all those releases. These are the URIs in the package recipe: http://wireless.kernel.org/download/crda/crda-1.1.3.tar.bz2 http://wireless.kernel.org/download/wireless-regdb/regulatory.bins/2013.01.11-regulatory.bin The correct ones are: https://www.kernel.org/pub/software/network/crda/crda-1.1.3.tar.bz2 https://www.kernel.org/pub/software/network/wireless-regdb/wireless-regdb-2013.01.11.tar.bz2 Notice that they not only changed the address but also now the regulatory binary is packed in a tarball. So at this point there are two options here: 1. Rework the recipe with the new locations, checksums and adapting the 'do_install' to copy the regulatory binary from a different directory. This has to be done for all the releases in the subject. 2. Just put the 'crda-1.1.3.tar.bz2' and '2013.01.11-regulatory.bin' in the openembedded mirror and let all the old releases work without changes in the recipes. My preference is number 2, along with an upgrade of the package to the new version 3.13 for the not-yet-released 'master' branch (there is currently a patch for that in the mailing list). Comments? - Javier Viguera Software Engineer ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-01-30 16:51 [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy Viguera, Javier @ 2015-01-30 17:23 ` Paul Eggleton 2015-02-03 9:05 ` Viguera, Javier 2015-02-16 13:24 ` Paul Eggleton 0 siblings, 2 replies; 15+ messages in thread From: Paul Eggleton @ 2015-01-30 17:23 UTC (permalink / raw) To: Viguera, Javier, Tom King; +Cc: openembedded-devel On Friday 30 January 2015 16:51:22 Viguera, Javier wrote: > Seems that CRDA maintainers did some changes that broke the fetch of the > package for all those releases. > > These are the URIs in the package recipe: > > http://wireless.kernel.org/download/crda/crda-1.1.3.tar.bz2 > http://wireless.kernel.org/download/wireless-regdb/regulatory.bins/2013.01.1 > 1-regulatory.bin > > The correct ones are: > > https://www.kernel.org/pub/software/network/crda/crda-1.1.3.tar.bz2 > https://www.kernel.org/pub/software/network/wireless-regdb/wireless-regdb-20 > 13.01.11.tar.bz2 > > Notice that they not only changed the address but also now the regulatory > binary is packed in a tarball. > > So at this point there are two options here: > > 1. Rework the recipe with the new locations, checksums and adapting the > 'do_install' to copy the regulatory binary from a different directory. This > has to be done for all the releases in the subject. > > 2. Just put the 'crda-1.1.3.tar.bz2' and '2013.01.11-regulatory.bin' in the > openembedded mirror and let all the old releases work without changes in > the recipes. > > My preference is number 2, along with an upgrade of the package to the new > version 3.13 for the not-yet-released 'master' branch (there is currently a > patch for that in the mailing list). I agree, #2 is the best option to take care of the older branches. Tom, can you please fetch the following files and add them to the OE source mirror: http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 http://distfiles.lesslinux.org/2013.01.11-regulatory.bin I've verified the md5sums match the recipe: 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin Cheers, Paul -- Paul Eggleton Intel Open Source Technology Centre ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-01-30 17:23 ` Paul Eggleton @ 2015-02-03 9:05 ` Viguera, Javier 2015-02-05 16:49 ` Paul Eggleton 2015-02-16 13:24 ` Paul Eggleton 1 sibling, 1 reply; 15+ messages in thread From: Viguera, Javier @ 2015-02-03 9:05 UTC (permalink / raw) To: 'Paul Eggleton', 'Tom King' Cc: 'openembedded-devel@lists.openembedded.org' Hi Paul and Tom, > -----Original Message----- > From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] > > I agree, #2 is the best option to take care of the older branches. > > Tom, can you please fetch the following files and add them to the OE > source > mirror: > > http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > > I've verified the md5sums match the recipe: > > 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin Good to know we agree on the best option. Could I make a humble request to speed up the copy of the packages to OE source mirror? We have a BSP layer that depends on this and currently our build is broken fetching crda. - Javier Viguera Software Engineer ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-03 9:05 ` Viguera, Javier @ 2015-02-05 16:49 ` Paul Eggleton 2015-02-05 16:54 ` Joe MacDonald ` (2 more replies) 0 siblings, 3 replies; 15+ messages in thread From: Paul Eggleton @ 2015-02-05 16:49 UTC (permalink / raw) To: 'Tom King', Khem Raj, Martin Jansa Cc: Viguera, Javier, openembedded-devel On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: > > -----Original Message----- > > From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] > > > > I agree, #2 is the best option to take care of the older branches. > > > > Tom, can you please fetch the following files and add them to the OE > > source > > > > mirror: > > http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > > http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > > > > I've verified the md5sums match the recipe: > > 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > > e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin > > Good to know we agree on the best option. > > Could I make a humble request to speed up the copy of the packages to OE > source mirror? > > We have a BSP layer that depends on this and currently our build is broken > fetching crda. I've been thinking about this, and this is getting ridiculous. Instead of manually adding files to the OE source mirror, I think it's time we simply had a populated fallback source mirror that has all the sources for at least the recipes in layers hosted on openembedded.org (if not other commonly used layers) aside from OE-Core which is already handled by the yoctoproject.org mirrors. This issue keeps coming up far too often. Is there a possibility we can set this up? Cheers, Paul -- Paul Eggleton Intel Open Source Technology Centre ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 16:49 ` Paul Eggleton @ 2015-02-05 16:54 ` Joe MacDonald 2015-02-05 17:45 ` Hugo Vasconcelos Saldanha 2015-02-05 17:52 ` Khem Raj 2 siblings, 0 replies; 15+ messages in thread From: Joe MacDonald @ 2015-02-05 16:54 UTC (permalink / raw) To: Paul Eggleton; +Cc: openembedded-devel, Viguera, Javier [-- Attachment #1: Type: text/plain, Size: 1741 bytes --] [Re: [oe] [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy] On 15.02.05 (Thu 16:49) Paul Eggleton wrote: > On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: > > > -----Original Message----- > > > From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] > > > > > > I agree, #2 is the best option to take care of the older branches. > > > > > > Tom, can you please fetch the following files and add them to the OE > > > source > > > > > > mirror: > > > http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > > > http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > > > > > > I've verified the md5sums match the recipe: > > > 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > > > e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin > > > > Good to know we agree on the best option. > > > > Could I make a humble request to speed up the copy of the packages to OE > > source mirror? > > > > We have a BSP layer that depends on this and currently our build is broken > > fetching crda. > > I've been thinking about this, and this is getting ridiculous. Instead of > manually adding files to the OE source mirror, I think it's time we simply had > a populated fallback source mirror that has all the sources for at least the > recipes in layers hosted on openembedded.org (if not other commonly used > layers) aside from OE-Core which is already handled by the yoctoproject.org > mirrors. This issue keeps coming up far too often. > > Is there a possibility we can set this up? That would be hugely helpful. -J. > > Cheers, > Paul > > -- > > Paul Eggleton > Intel Open Source Technology Centre -- -Joe MacDonald. :wq [-- Attachment #2: Digital signature --] [-- Type: application/pgp-signature, Size: 501 bytes --] ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 16:49 ` Paul Eggleton 2015-02-05 16:54 ` Joe MacDonald @ 2015-02-05 17:45 ` Hugo Vasconcelos Saldanha 2015-02-05 17:52 ` Khem Raj 2 siblings, 0 replies; 15+ messages in thread From: Hugo Vasconcelos Saldanha @ 2015-02-05 17:45 UTC (permalink / raw) To: openembedded-devel@lists.openembedded.org; +Cc: Viguera, Javier On Thu, Feb 05, 2015 at 02:49:13PM -0200, Paul Eggleton wrote: > On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: > > > -----Original Message----- > > > From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] > > > > > > I agree, #2 is the best option to take care of the older branches. > > > > > > Tom, can you please fetch the following files and add them to the OE > > > source > > > > > > mirror: > > > http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > > > http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > > > > > > I've verified the md5sums match the recipe: > > > 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > > > e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin > > > > Good to know we agree on the best option. > > > > Could I make a humble request to speed up the copy of the packages to OE > > source mirror? > > > > We have a BSP layer that depends on this and currently our build is broken > > fetching crda. > > I've been thinking about this, and this is getting ridiculous. Instead of > manually adding files to the OE source mirror, I think it's time we simply had > a populated fallback source mirror that has all the sources for at least the > recipes in layers hosted on openembedded.org (if not other commonly used > layers) aside from OE-Core which is already handled by the yoctoproject.org > mirrors. This issue keeps coming up far too often. The newest example of this problem, at least for me, is samba. The website is apparently gone and I'm not able to download its sources. -- Hugo ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 16:49 ` Paul Eggleton 2015-02-05 16:54 ` Joe MacDonald 2015-02-05 17:45 ` Hugo Vasconcelos Saldanha @ 2015-02-05 17:52 ` Khem Raj 2015-02-05 18:04 ` Tom King 2 siblings, 1 reply; 15+ messages in thread From: Khem Raj @ 2015-02-05 17:52 UTC (permalink / raw) To: Paul Eggleton; +Cc: Viguera, Javier, openembedded-devel > On Feb 5, 2015, at 8:49 AM, Paul Eggleton <paul.eggleton@linux.intel.com> wrote: > > On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: >>> -----Original Message----- >>> From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] >>> >>> I agree, #2 is the best option to take care of the older branches. >>> >>> Tom, can you please fetch the following files and add them to the OE >>> source >>> >>> mirror: >>> http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 >>> http://distfiles.lesslinux.org/2013.01.11-regulatory.bin >>> >>> I've verified the md5sums match the recipe: >>> 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 >>> e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin >> >> Good to know we agree on the best option. >> >> Could I make a humble request to speed up the copy of the packages to OE >> source mirror? >> >> We have a BSP layer that depends on this and currently our build is broken >> fetching crda. > > I've been thinking about this, and this is getting ridiculous. Instead of > manually adding files to the OE source mirror, I think it's time we simply had > a populated fallback source mirror that has all the sources for at least the > recipes in layers hosted on openembedded.org (if not other commonly used > layers) aside from OE-Core which is already handled by the yoctoproject.org > mirrors. This issue keeps coming up far too often. > > Is there a possibility we can set this up? We can infact setup a rsync from download directory of Martin’s world build jobs looking at Tom for help ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 17:52 ` Khem Raj @ 2015-02-05 18:04 ` Tom King 2015-02-05 18:49 ` Ash Charles 0 siblings, 1 reply; 15+ messages in thread From: Tom King @ 2015-02-05 18:04 UTC (permalink / raw) To: Khem Raj; +Cc: Paul Eggleton, Viguera, Javier, openembedded-devel We have the BW, Jenkins can do the rsync from the World Builds (if we clean the downloads directory) and I'll have to add some space to the Mirror Server but thats doable. Tom On Thu, Feb 5, 2015 at 9:52 AM, Khem Raj <raj.khem@gmail.com> wrote: > > > On Feb 5, 2015, at 8:49 AM, Paul Eggleton <paul.eggleton@linux.intel.com> > wrote: > > > > On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: > >>> -----Original Message----- > >>> From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] > >>> > >>> I agree, #2 is the best option to take care of the older branches. > >>> > >>> Tom, can you please fetch the following files and add them to the OE > >>> source > >>> > >>> mirror: > >>> http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > >>> http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > >>> > >>> I've verified the md5sums match the recipe: > >>> 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > >>> e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin > >> > >> Good to know we agree on the best option. > >> > >> Could I make a humble request to speed up the copy of the packages to OE > >> source mirror? > >> > >> We have a BSP layer that depends on this and currently our build is > broken > >> fetching crda. > > > > I've been thinking about this, and this is getting ridiculous. Instead of > > manually adding files to the OE source mirror, I think it's time we > simply had > > a populated fallback source mirror that has all the sources for at least > the > > recipes in layers hosted on openembedded.org (if not other commonly used > > layers) aside from OE-Core which is already handled by the > yoctoproject.org > > mirrors. This issue keeps coming up far too often. > > > > Is there a possibility we can set this up? > > We can infact setup a rsync from download directory of Martin’s world > build jobs > looking at Tom for help ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 18:04 ` Tom King @ 2015-02-05 18:49 ` Ash Charles 2015-02-05 19:03 ` Tom King 2015-02-05 19:06 ` Martin Jansa 0 siblings, 2 replies; 15+ messages in thread From: Ash Charles @ 2015-02-05 18:49 UTC (permalink / raw) To: openembedded-devel; +Cc: Paul Eggleton, Viguera, Javier Hi, Why clean the downloads directory? Roughly how big is the download directory after a world build? For gumstix, I maintain a source mirror on AWS S3 populated by our automated builders running BB_GENERATE_MIRROR_TARBALLS = "1". If it would be useful to the community, I can see about adding files to this as an additional mirror. --Ash On Thu, Feb 5, 2015 at 10:04 AM, Tom King <ka6sox@gmail.com> wrote: > We have the BW, Jenkins can do the rsync from the World Builds (if we > clean the downloads directory) and I'll have to add some space to the > Mirror Server but thats doable. > > Tom > > On Thu, Feb 5, 2015 at 9:52 AM, Khem Raj <raj.khem@gmail.com> wrote: > >> >> > On Feb 5, 2015, at 8:49 AM, Paul Eggleton <paul.eggleton@linux.intel.com> >> wrote: >> > >> > On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: >> >>> -----Original Message----- >> >>> From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] >> >>> >> >>> I agree, #2 is the best option to take care of the older branches. >> >>> >> >>> Tom, can you please fetch the following files and add them to the OE >> >>> source >> >>> >> >>> mirror: >> >>> http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 >> >>> http://distfiles.lesslinux.org/2013.01.11-regulatory.bin >> >>> >> >>> I've verified the md5sums match the recipe: >> >>> 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 >> >>> e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin >> >> >> >> Good to know we agree on the best option. >> >> >> >> Could I make a humble request to speed up the copy of the packages to OE >> >> source mirror? >> >> >> >> We have a BSP layer that depends on this and currently our build is >> broken >> >> fetching crda. >> > >> > I've been thinking about this, and this is getting ridiculous. Instead of >> > manually adding files to the OE source mirror, I think it's time we >> simply had >> > a populated fallback source mirror that has all the sources for at least >> the >> > recipes in layers hosted on openembedded.org (if not other commonly used >> > layers) aside from OE-Core which is already handled by the >> yoctoproject.org >> > mirrors. This issue keeps coming up far too often. >> > >> > Is there a possibility we can set this up? >> >> We can infact setup a rsync from download directory of Martin’s world >> build jobs >> looking at Tom for help > -- > _______________________________________________ > Openembedded-devel mailing list > Openembedded-devel@lists.openembedded.org > http://lists.openembedded.org/mailman/listinfo/openembedded-devel ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 18:49 ` Ash Charles @ 2015-02-05 19:03 ` Tom King 2015-02-05 19:21 ` Ash Charles 2015-02-05 19:06 ` Martin Jansa 1 sibling, 1 reply; 15+ messages in thread From: Tom King @ 2015-02-05 19:03 UTC (permalink / raw) To: openembedded-devel; +Cc: Paul Eggleton, Viguera, Javier 150GB On Thu, Feb 5, 2015, 10:50 Ash Charles <ashcharles@gmail.com> wrote: > Hi, > > Why clean the downloads directory? > > Roughly how big is the download directory after a world build? > > For gumstix, I maintain a source mirror on AWS S3 populated by our > automated builders running BB_GENERATE_MIRROR_TARBALLS = "1". If it > would be useful to the community, I can see about adding files to this > as an additional mirror. > > --Ash > > On Thu, Feb 5, 2015 at 10:04 AM, Tom King <ka6sox@gmail.com> wrote: > > We have the BW, Jenkins can do the rsync from the World Builds (if we > > clean the downloads directory) and I'll have to add some space to the > > Mirror Server but thats doable. > > > > Tom > > > > On Thu, Feb 5, 2015 at 9:52 AM, Khem Raj <raj.khem@gmail.com> wrote: > > > >> > >> > On Feb 5, 2015, at 8:49 AM, Paul Eggleton < > paul.eggleton@linux.intel.com> > >> wrote: > >> > > >> > On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: > >> >>> -----Original Message----- > >> >>> From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] > >> >>> > >> >>> I agree, #2 is the best option to take care of the older branches. > >> >>> > >> >>> Tom, can you please fetch the following files and add them to the OE > >> >>> source > >> >>> > >> >>> mirror: > >> >>> http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > >> >>> http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > >> >>> > >> >>> I've verified the md5sums match the recipe: > >> >>> 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > >> >>> e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin > >> >> > >> >> Good to know we agree on the best option. > >> >> > >> >> Could I make a humble request to speed up the copy of the packages > to OE > >> >> source mirror? > >> >> > >> >> We have a BSP layer that depends on this and currently our build is > >> broken > >> >> fetching crda. > >> > > >> > I've been thinking about this, and this is getting ridiculous. > Instead of > >> > manually adding files to the OE source mirror, I think it's time we > >> simply had > >> > a populated fallback source mirror that has all the sources for at > least > >> the > >> > recipes in layers hosted on openembedded.org (if not other commonly > used > >> > layers) aside from OE-Core which is already handled by the > >> yoctoproject.org > >> > mirrors. This issue keeps coming up far too often. > >> > > >> > Is there a possibility we can set this up? > >> > >> We can infact setup a rsync from download directory of Martin’s world > >> build jobs > >> looking at Tom for help > > -- > > _______________________________________________ > > Openembedded-devel mailing list > > Openembedded-devel@lists.openembedded.org > > http://lists.openembedded.org/mailman/listinfo/openembedded-devel > -- > _______________________________________________ > Openembedded-devel mailing list > Openembedded-devel@lists.openembedded.org > http://lists.openembedded.org/mailman/listinfo/openembedded-devel > ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 19:03 ` Tom King @ 2015-02-05 19:21 ` Ash Charles 2015-02-06 16:05 ` Ash Charles 0 siblings, 1 reply; 15+ messages in thread From: Ash Charles @ 2015-02-05 19:21 UTC (permalink / raw) To: openembedded-devel; +Cc: Paul Eggleton, Viguera, Javier On Thu, Feb 5, 2015 at 11:03 AM, Tom King <ka6sox@gmail.com> wrote: > 150GB Estimate of monthly bandwidth? ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 19:21 ` Ash Charles @ 2015-02-06 16:05 ` Ash Charles 0 siblings, 0 replies; 15+ messages in thread From: Ash Charles @ 2015-02-06 16:05 UTC (permalink / raw) To: openembedded-devel; +Cc: Paul Eggleton, Viguera, Javier Gumstix can provide additional mirroring if that'd be useful (I've been told I just have to keep tabs on the cost ;-)). The mirror is found here: http://source-cache.gumstix.org. It is a CDN+S3 so it should be reasonably quick worldwide (just got ~3MB/s down for wget http://source-cache.gumstix.org/qt-everywhere-opensource-src-4.8.6.tar.gz). Whenever Jenkins wants to sync, it'd need to call this: $ s3cmd --rr --exclude="*.done" -P sync <path-to-dl-dir>/* s3://source-cache/ As well, the server would need 's3cmd' utility installed and some magic credentials from me. --Ash On Thu, Feb 5, 2015 at 11:21 AM, Ash Charles <ashcharles@gmail.com> wrote: > On Thu, Feb 5, 2015 at 11:03 AM, Tom King <ka6sox@gmail.com> wrote: >> 150GB > Estimate of monthly bandwidth? ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-05 18:49 ` Ash Charles 2015-02-05 19:03 ` Tom King @ 2015-02-05 19:06 ` Martin Jansa 1 sibling, 0 replies; 15+ messages in thread From: Martin Jansa @ 2015-02-05 19:06 UTC (permalink / raw) To: openembedded-devel; +Cc: Paul Eggleton, Viguera, Javier [-- Attachment #1: Type: text/plain, Size: 3290 bytes --] On Thu, Feb 05, 2015 at 10:49:23AM -0800, Ash Charles wrote: > Hi, > > Why clean the downloads directory? > > Roughly how big is the download directory after a world build? 42G with unpacked SCMs, but without BB_GENERATE_MIRROR_TARBALLS so it will be only a bit smaller after excluding git2 and svn dirs. But I agree that we should keep it all. > For gumstix, I maintain a source mirror on AWS S3 populated by our > automated builders running BB_GENERATE_MIRROR_TARBALLS = "1". If it > would be useful to the community, I can see about adding files to this > as an additional mirror. > > --Ash > > On Thu, Feb 5, 2015 at 10:04 AM, Tom King <ka6sox@gmail.com> wrote: > > We have the BW, Jenkins can do the rsync from the World Builds (if we > > clean the downloads directory) and I'll have to add some space to the > > Mirror Server but thats doable. > > > > Tom > > > > On Thu, Feb 5, 2015 at 9:52 AM, Khem Raj <raj.khem@gmail.com> wrote: > > > >> > >> > On Feb 5, 2015, at 8:49 AM, Paul Eggleton <paul.eggleton@linux.intel.com> > >> wrote: > >> > > >> > On Tuesday 03 February 2015 09:05:54 Viguera, Javier wrote: > >> >>> -----Original Message----- > >> >>> From: Paul Eggleton [mailto:paul.eggleton@linux.intel.com] > >> >>> > >> >>> I agree, #2 is the best option to take care of the older branches. > >> >>> > >> >>> Tom, can you please fetch the following files and add them to the OE > >> >>> source > >> >>> > >> >>> mirror: > >> >>> http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > >> >>> http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > >> >>> > >> >>> I've verified the md5sums match the recipe: > >> >>> 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > >> >>> e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin > >> >> > >> >> Good to know we agree on the best option. > >> >> > >> >> Could I make a humble request to speed up the copy of the packages to OE > >> >> source mirror? > >> >> > >> >> We have a BSP layer that depends on this and currently our build is > >> broken > >> >> fetching crda. > >> > > >> > I've been thinking about this, and this is getting ridiculous. Instead of > >> > manually adding files to the OE source mirror, I think it's time we > >> simply had > >> > a populated fallback source mirror that has all the sources for at least > >> the > >> > recipes in layers hosted on openembedded.org (if not other commonly used > >> > layers) aside from OE-Core which is already handled by the > >> yoctoproject.org > >> > mirrors. This issue keeps coming up far too often. > >> > > >> > Is there a possibility we can set this up? > >> > >> We can infact setup a rsync from download directory of Martin’s world > >> build jobs > >> looking at Tom for help > > -- > > _______________________________________________ > > Openembedded-devel mailing list > > Openembedded-devel@lists.openembedded.org > > http://lists.openembedded.org/mailman/listinfo/openembedded-devel > -- > _______________________________________________ > Openembedded-devel mailing list > Openembedded-devel@lists.openembedded.org > http://lists.openembedded.org/mailman/listinfo/openembedded-devel -- Martin 'JaMa' Jansa jabber: Martin.Jansa@gmail.com [-- Attachment #2: Digital signature --] [-- Type: application/pgp-signature, Size: 188 bytes --] ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-01-30 17:23 ` Paul Eggleton 2015-02-03 9:05 ` Viguera, Javier @ 2015-02-16 13:24 ` Paul Eggleton 2015-02-20 9:43 ` Paul Eggleton 1 sibling, 1 reply; 15+ messages in thread From: Paul Eggleton @ 2015-02-16 13:24 UTC (permalink / raw) To: Tom King; +Cc: Viguera, Javier, openembedded-devel, scerveau On Friday 30 January 2015 17:23:55 Paul Eggleton wrote: > On Friday 30 January 2015 16:51:22 Viguera, Javier wrote: > > Seems that CRDA maintainers did some changes that broke the fetch of the > > package for all those releases. > > > > These are the URIs in the package recipe: > > > > http://wireless.kernel.org/download/crda/crda-1.1.3.tar.bz2 > > http://wireless.kernel.org/download/wireless-regdb/regulatory.bins/2013.01 > > .1 1-regulatory.bin > > > > The correct ones are: > > > > https://www.kernel.org/pub/software/network/crda/crda-1.1.3.tar.bz2 > > https://www.kernel.org/pub/software/network/wireless-regdb/wireless-regdb-> > 20 13.01.11.tar.bz2 > > > > Notice that they not only changed the address but also now the regulatory > > binary is packed in a tarball. > > > > So at this point there are two options here: > > > > 1. Rework the recipe with the new locations, checksums and adapting the > > 'do_install' to copy the regulatory binary from a different directory. > > This > > has to be done for all the releases in the subject. > > > > 2. Just put the 'crda-1.1.3.tar.bz2' and '2013.01.11-regulatory.bin' in > > the > > openembedded mirror and let all the old releases work without changes in > > the recipes. > > > > My preference is number 2, along with an upgrade of the package to the new > > version 3.13 for the not-yet-released 'master' branch (there is currently > > a > > patch for that in the mailing list). > > I agree, #2 is the best option to take care of the older branches. > > Tom, can you please fetch the following files and add them to the OE source > mirror: > > http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > > I've verified the md5sums match the recipe: > > 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin Tom could you please upload these files? People are still stumbling over this problem. Thanks, Paul -- Paul Eggleton Intel Open Source Technology Centre ^ permalink raw reply [flat|nested] 15+ messages in thread
* Re: [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy 2015-02-16 13:24 ` Paul Eggleton @ 2015-02-20 9:43 ` Paul Eggleton 0 siblings, 0 replies; 15+ messages in thread From: Paul Eggleton @ 2015-02-20 9:43 UTC (permalink / raw) To: Tom King; +Cc: Viguera, Javier, openembedded-devel, scerveau On Monday 16 February 2015 13:24:50 Paul Eggleton wrote: > On Friday 30 January 2015 17:23:55 Paul Eggleton wrote: > > On Friday 30 January 2015 16:51:22 Viguera, Javier wrote: > > > Seems that CRDA maintainers did some changes that broke the fetch of the > > > package for all those releases. > > > > > > These are the URIs in the package recipe: > > > > > > http://wireless.kernel.org/download/crda/crda-1.1.3.tar.bz2 > > > http://wireless.kernel.org/download/wireless-regdb/regulatory.bins/2013. > > > 01 > > > .1 1-regulatory.bin > > > > > > The correct ones are: > > > > > > https://www.kernel.org/pub/software/network/crda/crda-1.1.3.tar.bz2 > > > https://www.kernel.org/pub/software/network/wireless-regdb/wireless-regd > > > b-> > 20 13.01.11.tar.bz2 > > > > > > Notice that they not only changed the address but also now the > > > regulatory > > > binary is packed in a tarball. > > > > > > So at this point there are two options here: > > > > > > 1. Rework the recipe with the new locations, checksums and adapting the > > > 'do_install' to copy the regulatory binary from a different directory. > > > This > > > has to be done for all the releases in the subject. > > > > > > 2. Just put the 'crda-1.1.3.tar.bz2' and '2013.01.11-regulatory.bin' in > > > the > > > openembedded mirror and let all the old releases work without changes in > > > the recipes. > > > > > > My preference is number 2, along with an upgrade of the package to the > > > new > > > version 3.13 for the not-yet-released 'master' branch (there is > > > currently > > > a > > > patch for that in the mailing list). > > > > I agree, #2 is the best option to take care of the older branches. > > > > Tom, can you please fetch the following files and add them to the OE > > source > > > > mirror: > > http://distfiles.lesslinux.org/crda-1.1.3.tar.bz2 > > http://distfiles.lesslinux.org/2013.01.11-regulatory.bin > > > > I've verified the md5sums match the recipe: > > 29579185e06a75675507527243d28e5c crda-1.1.3.tar.bz2 > > e0c8a5ca63fb8bf803213f9a0c90b50b 2013.01.11-regulatory.bin > > Tom could you please upload these files? People are still stumbling over > this problem. ping? -- Paul Eggleton Intel Open Source Technology Centre ^ permalink raw reply [flat|nested] 15+ messages in thread
end of thread, other threads:[~2015-02-20 9:43 UTC | newest] Thread overview: 15+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2015-01-30 16:51 [meta-networking] crda-1.1.3 broken in dylan, dora, daisy and dizzy Viguera, Javier 2015-01-30 17:23 ` Paul Eggleton 2015-02-03 9:05 ` Viguera, Javier 2015-02-05 16:49 ` Paul Eggleton 2015-02-05 16:54 ` Joe MacDonald 2015-02-05 17:45 ` Hugo Vasconcelos Saldanha 2015-02-05 17:52 ` Khem Raj 2015-02-05 18:04 ` Tom King 2015-02-05 18:49 ` Ash Charles 2015-02-05 19:03 ` Tom King 2015-02-05 19:21 ` Ash Charles 2015-02-06 16:05 ` Ash Charles 2015-02-05 19:06 ` Martin Jansa 2015-02-16 13:24 ` Paul Eggleton 2015-02-20 9:43 ` Paul Eggleton
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox