All of lore.kernel.org
 help / color / mirror / Atom feed
From: Richard Purdie <richard.purdie@linuxfoundation.org>
To: Patches and discussions about the oe-core layer
	<openembedded-core@lists.openembedded.org>
Cc: openembedded-core <openembedded-core@openembedded.org>,
	openembedded-devel@lists.openembedded.org
Subject: Re: [oe] [PATCH] sstate: Add a two character subdirectory to the sstate directory layout
Date: Thu, 02 Aug 2012 17:15:27 +0100	[thread overview]
Message-ID: <1343924127.9756.88.camel@ted> (raw)
In-Reply-To: <CABcZANmUVia_qXt7a3oG5ofJeJYVO29gOoLaLb7zT=64W00CxQ@mail.gmail.com>

On Thu, 2012-08-02 at 08:59 -0700, Chris Larson wrote:
> On Thu, Aug 2, 2012 at 8:53 AM, Richard Purdie
> <richard.purdie@linuxfoundation.org> wrote:
> > On Thu, 2012-08-02 at 16:14 +0200, Martin Jansa wrote:
> >> 2 more ideas:
> >>
> >> 1) would be great to also download file.sigdata if it exists, to be able
> >>    to compare them when they change even on machine which downloaded
> >>    older sstate file from remote url
> >> 2) if the reason for this patch was number of files in shared
> >>    sstate-cache directory, then fetcher creating .done files makes
> >>    number double too (would be fine if fetcher stores all 3 files
> >>    (.tgz, .tgz.sigdata, .tgz.done) in right prefix, or moves them to
> >>    right prefix instead of symlinks.
> >
> > I'm aware of the problem. The main issue is that we probably need to
> > start enforcing complete paths for all downloads in DL_DIR, including
> > http:// urls. This would resolve conflicts like:
> >
> > SRC_URI = "http://server1.org/somefile.patch \
> >            http://server2.org/somefile.patch"
> >
> > where the two files are different. The trouble is it will pretty much
> > break all the source mirrors :(.
> 
> I think we need to stop the tendency to use DL_DIR as is as a mirror,
> and instead create a task or something to populate a mirror directory
> from the DL_DIR. This would avoid potential issues with licensing if
> it uses license filtering to control what gets populated, as well.

I agree, there are some issues in that area and we shoudl encourage
people to think about this.

Having said that, I'm worried we are going to hit conflicts over DL_DIR
regardless of that.

Perhaps making this change might be a way to remind people of that....

Cheers,

Richard




WARNING: multiple messages have this Message-ID (diff)
From: Richard Purdie <richard.purdie@linuxfoundation.org>
To: Patches and discussions about the oe-core layer
	<openembedded-core@lists.openembedded.org>
Cc: openembedded-core <openembedded-core@openembedded.org>,
	openembedded-devel@lists.openembedded.org
Subject: Re: [OE-core] [PATCH] sstate: Add a two character subdirectory to the sstate directory layout
Date: Thu, 02 Aug 2012 17:15:27 +0100	[thread overview]
Message-ID: <1343924127.9756.88.camel@ted> (raw)
In-Reply-To: <CABcZANmUVia_qXt7a3oG5ofJeJYVO29gOoLaLb7zT=64W00CxQ@mail.gmail.com>

On Thu, 2012-08-02 at 08:59 -0700, Chris Larson wrote:
> On Thu, Aug 2, 2012 at 8:53 AM, Richard Purdie
> <richard.purdie@linuxfoundation.org> wrote:
> > On Thu, 2012-08-02 at 16:14 +0200, Martin Jansa wrote:
> >> 2 more ideas:
> >>
> >> 1) would be great to also download file.sigdata if it exists, to be able
> >>    to compare them when they change even on machine which downloaded
> >>    older sstate file from remote url
> >> 2) if the reason for this patch was number of files in shared
> >>    sstate-cache directory, then fetcher creating .done files makes
> >>    number double too (would be fine if fetcher stores all 3 files
> >>    (.tgz, .tgz.sigdata, .tgz.done) in right prefix, or moves them to
> >>    right prefix instead of symlinks.
> >
> > I'm aware of the problem. The main issue is that we probably need to
> > start enforcing complete paths for all downloads in DL_DIR, including
> > http:// urls. This would resolve conflicts like:
> >
> > SRC_URI = "http://server1.org/somefile.patch \
> >            http://server2.org/somefile.patch"
> >
> > where the two files are different. The trouble is it will pretty much
> > break all the source mirrors :(.
> 
> I think we need to stop the tendency to use DL_DIR as is as a mirror,
> and instead create a task or something to populate a mirror directory
> from the DL_DIR. This would avoid potential issues with licensing if
> it uses license filtering to control what gets populated, as well.

I agree, there are some issues in that area and we shoudl encourage
people to think about this.

Having said that, I'm worried we are going to hit conflicts over DL_DIR
regardless of that.

Perhaps making this change might be a way to remind people of that....

Cheers,

Richard




  reply	other threads:[~2012-08-02 16:27 UTC|newest]

Thread overview: 18+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-07-25 21:09 [PATCH] sstate: Add a two character subdirectory to the sstate directory layout Richard Purdie
2012-07-25 22:12 ` McClintock Matthew-B29882
2012-08-02 13:53 ` [oe] " Martin Jansa
2012-08-02 13:53   ` Martin Jansa
2012-08-02 14:14   ` [oe] " Martin Jansa
2012-08-02 14:14     ` Martin Jansa
2012-08-02 15:53     ` [oe] " Richard Purdie
2012-08-02 15:53       ` [OE-core] " Richard Purdie
2012-08-02 15:59       ` [oe] " Chris Larson
2012-08-02 15:59         ` [OE-core] " Chris Larson
2012-08-02 16:15         ` Richard Purdie [this message]
2012-08-02 16:15           ` Richard Purdie
2012-08-02 19:40       ` [oe] " Martin Jansa
2012-08-02 19:40         ` [OE-core] " Martin Jansa
2012-08-02 19:57         ` [oe] " Richard Purdie
2012-08-02 19:57           ` [OE-core] " Richard Purdie
2012-08-06  7:09           ` [oe] " Martin Jansa
2012-08-06  7:09             ` [OE-core] " Martin Jansa

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1343924127.9756.88.camel@ted \
    --to=richard.purdie@linuxfoundation.org \
    --cc=openembedded-core@lists.openembedded.org \
    --cc=openembedded-core@openembedded.org \
    --cc=openembedded-devel@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.