* [Buildroot] Buildroot Package Mirror Script
@ 2013-10-21 19:15 Ryan Barnett
2013-10-21 21:58 ` Yann E. MORIN
0 siblings, 1 reply; 6+ messages in thread
From: Ryan Barnett @ 2013-10-21 19:15 UTC (permalink / raw)
To: buildroot
Thomas P and/or Peter,
I was wondering if it would be possible to get a hold of the scripts that
are used to populate sources.buildroot.net mirror. Our build server
resides behind a very restrictive firewall and we would like to automate
(nightly) the pulling of new packages from the most recent version
of buildroot source. We've attempted to implement our own script to do
this
with 'make allyespackageconfig' followed by 'make source', however, we
are running into a few gotchas so we were hoping that we could
potentially piggy back off the work that has been done for the
sources.buildroot.net.
Please let me know if you are able to help.
Thanks,
-Ryan
------------------------------------------------------------
Ryan J Barnett / Software Engineer / Platform SW
MS 137-157, 855 35th St NE, Cedar Rapids, IA, 52498-3161, US
rjbarnet at rockwellcollins.com
www.rockwellcollins.com
^ permalink raw reply [flat|nested] 6+ messages in thread
* [Buildroot] Buildroot Package Mirror Script
2013-10-21 19:15 [Buildroot] Buildroot Package Mirror Script Ryan Barnett
@ 2013-10-21 21:58 ` Yann E. MORIN
2013-10-22 13:10 ` Thomas Petazzoni
0 siblings, 1 reply; 6+ messages in thread
From: Yann E. MORIN @ 2013-10-21 21:58 UTC (permalink / raw)
To: buildroot
Ryan, All,
On 2013-10-21 14:15 -0500, Ryan Barnett spake thusly:
> Thomas P and/or Peter,
>
> I was wondering if it would be possible to get a hold of the scripts that
> are used to populate sources.buildroot.net mirror. Our build server
> resides behind a very restrictive firewall and we would like to automate
> (nightly) the pulling of new packages from the most recent version
> of buildroot source. We've attempted to implement our own script to do
> this
> with 'make allyespackageconfig' followed by 'make source', however, we
> are running into a few gotchas so we were hoping that we could
> potentially piggy back off the work that has been done for the
> sources.buildroot.net.
I'm afraid what you did is what is used to populate sources.b.o.
There are no specific 'script' or procedure to do that.
What are the gotchas you're bumped into?
IIRC, there are a few isues yet with some host-packages that are nmot
downloaded with 'make sources'. Is that your issue?. I think Thomas P.
has a set od chages to fix this issue. Thomas?
Regards,
Yann E. MORIN.
--
.-----------------.--------------------.------------------.--------------------.
| Yann E. MORIN | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +33 662 376 056 | Software Designer | \ / CAMPAIGN | ___ |
| +33 223 225 172 `------------.-------: X AGAINST | \e/ There is no |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL | v conspiracy. |
'------------------------------^-------^------------------^--------------------'
^ permalink raw reply [flat|nested] 6+ messages in thread
* [Buildroot] Buildroot Package Mirror Script
2013-10-21 21:58 ` Yann E. MORIN
@ 2013-10-22 13:10 ` Thomas Petazzoni
2013-10-22 13:19 ` Ryan Barnett
0 siblings, 1 reply; 6+ messages in thread
From: Thomas Petazzoni @ 2013-10-22 13:10 UTC (permalink / raw)
To: buildroot
Dear Yann E. MORIN,
On Mon, 21 Oct 2013 22:58:49 +0100, Yann E. MORIN wrote:
> I'm afraid what you did is what is used to populate sources.b.o.
> There are no specific 'script' or procedure to do that.
>
> What are the gotchas you're bumped into?
>
> IIRC, there are a few isues yet with some host-packages that are nmot
> downloaded with 'make sources'. Is that your issue?. I think Thomas P.
> has a set od chages to fix this issue. Thomas?
True. As of today, the toolchain packages are not being handled by the
'make source' infrastructure, though I've already sent patches to fix
that.
Also, I think 'make allyespackageconfig' + 'make source' is inherently
broken: we have many Config.in "choice" statements, and depending on
the value of the choice, the tarballs to pull will not be the same
(packages supporting several versions, X.org big choice on KDrive vs.
full modular X.org, etc.), so there is in fact no way to simply pull
*all* possible tarballs. "make source" should guarantee you that it
downloads all the sources needed for your *current* configuration. But
there is no entirely full-proof way to download absolutely all possible
tarballs that Buildroot may need.
Thomas
--
Thomas Petazzoni, CTO, Free Electrons
Embedded Linux, Kernel and Android engineering
http://free-electrons.com
^ permalink raw reply [flat|nested] 6+ messages in thread
* [Buildroot] Buildroot Package Mirror Script
2013-10-22 13:10 ` Thomas Petazzoni
@ 2013-10-22 13:19 ` Ryan Barnett
2013-10-22 14:10 ` Thomas Petazzoni
0 siblings, 1 reply; 6+ messages in thread
From: Ryan Barnett @ 2013-10-22 13:19 UTC (permalink / raw)
To: buildroot
Thomas P, Yann,
Thomas Petazzoni <thomas.petazzoni@free-electrons.com> wrote on 10/22/2013
08:10:11 AM:
> Dear Yann E. MORIN,
>
> On Mon, 21 Oct 2013 22:58:49 +0100, Yann E. MORIN wrote:
>
> > I'm afraid what you did is what is used to populate sources.b.o.
> > There are no specific 'script' or procedure to do that.
> >
> > What are the gotchas you're bumped into?
> >
> > IIRC, there are a few isues yet with some host-packages that are nmot
> > downloaded with 'make sources'. Is that your issue?. I think Thomas P.
> > has a set od chages to fix this issue. Thomas?
>
> True. As of today, the toolchain packages are not being handled by the
> 'make source' infrastructure, though I've already sent patches to fix
> that.
>
> Also, I think 'make allyespackageconfig' + 'make source' is inherently
> broken: we have many Config.in "choice" statements, and depending on
> the value of the choice, the tarballs to pull will not be the same
> (packages supporting several versions, X.org big choice on KDrive vs.
> full modular X.org, etc.), so there is in fact no way to simply pull
> *all* possible tarballs. "make source" should guarantee you that it
> downloads all the sources needed for your *current* configuration. But
> there is no entirely full-proof way to download absolutely all possible
> tarballs that Buildroot may need.
Thanks for the information, I was hoping there was some magic that was
being done for the buildroot mirror that I was missing. I guess we will
just have to maintain an 'allyespackageconfig' that fixes all of the
gotchas.
Thanks,
-Ryan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.busybox.net/pipermail/buildroot/attachments/20131022/89057264/attachment.html>
^ permalink raw reply [flat|nested] 6+ messages in thread
* [Buildroot] Buildroot Package Mirror Script
2013-10-22 13:19 ` Ryan Barnett
@ 2013-10-22 14:10 ` Thomas Petazzoni
2013-10-22 14:40 ` Ryan Barnett
0 siblings, 1 reply; 6+ messages in thread
From: Thomas Petazzoni @ 2013-10-22 14:10 UTC (permalink / raw)
To: buildroot
Dear Ryan Barnett,
On Tue, 22 Oct 2013 08:19:12 -0500, Ryan Barnett wrote:
> > Also, I think 'make allyespackageconfig' + 'make source' is inherently
> > broken: we have many Config.in "choice" statements, and depending on
> > the value of the choice, the tarballs to pull will not be the same
> > (packages supporting several versions, X.org big choice on KDrive vs.
> > full modular X.org, etc.), so there is in fact no way to simply pull
> > *all* possible tarballs. "make source" should guarantee you that it
> > downloads all the sources needed for your *current* configuration. But
> > there is no entirely full-proof way to download absolutely all possible
> > tarballs that Buildroot may need.
>
> Thanks for the information, I was hoping there was some magic that was
> being done for the buildroot mirror that I was missing. I guess we will
> just have to maintain an 'allyespackageconfig' that fixes all of the
> gotchas.
It'd be nice though if you could give details about what those
"gotchas" are, so we can see if they are gotchas that should be fixed,
or inherent limitations of the Buildroot design.
Thomas
--
Thomas Petazzoni, CTO, Free Electrons
Embedded Linux, Kernel and Android engineering
http://free-electrons.com
^ permalink raw reply [flat|nested] 6+ messages in thread
* [Buildroot] Buildroot Package Mirror Script
2013-10-22 14:10 ` Thomas Petazzoni
@ 2013-10-22 14:40 ` Ryan Barnett
0 siblings, 0 replies; 6+ messages in thread
From: Ryan Barnett @ 2013-10-22 14:40 UTC (permalink / raw)
To: buildroot
Thomas,
Thomas Petazzoni <thomas.petazzoni@free-electrons.com> wrote on 10/22/2013
09:10:48 AM:
> Dear Ryan Barnett,
>
> On Tue, 22 Oct 2013 08:19:12 -0500, Ryan Barnett wrote:
>
> > > Also, I think 'make allyespackageconfig' + 'make source' is
inherently
> > > broken: we have many Config.in "choice" statements, and depending on
> > > the value of the choice, the tarballs to pull will not be the same
> > > (packages supporting several versions, X.org big choice on KDrive
vs.
> > > full modular X.org, etc.), so there is in fact no way to simply pull
> > > *all* possible tarballs. "make source" should guarantee you that it
> > > downloads all the sources needed for your *current* configuration.
But
> > > there is no entirely full-proof way to download absolutely all
possible
> > > tarballs that Buildroot may need.
> >
> > Thanks for the information, I was hoping there was some magic that was
> > being done for the buildroot mirror that I was missing. I guess we
will
> > just have to maintain an 'allyespackageconfig' that fixes all of the
> > gotchas.
>
> It'd be nice though if you could give details about what those
> "gotchas" are, so we can see if they are gotchas that should be fixed,
> or inherent limitations of the Buildroot design.
I will be sure to let you guys know, right now I haven't had time to mess
around with too much other than to attempt 'make allyespackageconfig'
'make source'. At that point I gave up know it wasn't going to be as easy
as I thought it was...
Clayton Shotwell has been the person that has investigated this so I will
tell him to report his issues that he is experiencing.
Thanks,
-Ryan
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2013-10-22 14:40 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2013-10-21 19:15 [Buildroot] Buildroot Package Mirror Script Ryan Barnett
2013-10-21 21:58 ` Yann E. MORIN
2013-10-22 13:10 ` Thomas Petazzoni
2013-10-22 13:19 ` Ryan Barnett
2013-10-22 14:10 ` Thomas Petazzoni
2013-10-22 14:40 ` Ryan Barnett
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox