Reducing nightly/release build artifacts.

Reducing nightly/release build artifacts.

[Flanagan, Elizabeth]

Folks,

I'd like to start looking at reducing the number of artifacts we're
releasing both for our nightly builds (which is at 250,000 artifacts
and .25 TB!) and releases.

What I'm thinking is this:

Reduce nightly:
- Reduce ADT-REPO to just qemu* arches for all builds
- If every QA team could provide me a list of what files they actually
need I could reduce the published artifacts to *just* what is needed.

Reduce releases:
- Reduce ADT-REPO to just qemu
- Don't release ipk/rpm/debs. Continue to release ipks through ADT
- Don't release machines outside of BSP tarball /binary directory

If folks who do QA could get me a list of all the files they use, we
can start removing excess artifacts. I know this is a balance, but I'd
really like us to start targeting our release artifacts to just the
things we need.


-- 
Elizabeth Flanagan
Yocto Project
Build and Release

Re: Reducing nightly/release build artifacts.

[Otavio Salvador]

Hello Beth,

On Wed, Mar 26, 2014 at 6:14 PM, Flanagan, Elizabeth
<elizabeth.flanagan@intel.com> wrote:
> I'd like to start looking at reducing the number of artifacts we're
> releasing both for our nightly builds (which is at 250,000 artifacts
> and .25 TB!) and releases.
>
> What I'm thinking is this:
>
> Reduce nightly:
> - Reduce ADT-REPO to just qemu* arches for all builds
> - If every QA team could provide me a list of what files they actually
> need I could reduce the published artifacts to *just* what is needed.
>
> Reduce releases:
> - Reduce ADT-REPO to just qemu
> - Don't release ipk/rpm/debs. Continue to release ipks through ADT
> - Don't release machines outside of BSP tarball /binary directory
>
> If folks who do QA could get me a list of all the files they use, we
> can start removing excess artifacts. I know this is a balance, but I'd
> really like us to start targeting our release artifacts to just the
> things we need.

I fully agree on that.

Is there anything you need specifically from me?

-- 
Otavio Salvador                             O.S. Systems
http://www.ossystems.com.br        http://code.ossystems.com.br
Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750

Re: Reducing nightly/release build artifacts.

[Flanagan, Elizabeth]

A list of exactly what files you use for QA would be grand.

We can use http://autobuilder.yoctoproject.org/pub/nightly/20140326-1/
as our base.

-b

On Wed, Mar 26, 2014 at 2:22 PM, Otavio Salvador
<otavio@ossystems.com.br> wrote:
> Hello Beth,
>
> On Wed, Mar 26, 2014 at 6:14 PM, Flanagan, Elizabeth
> <elizabeth.flanagan@intel.com> wrote:
>> I'd like to start looking at reducing the number of artifacts we're
>> releasing both for our nightly builds (which is at 250,000 artifacts
>> and .25 TB!) and releases.
>>
>> What I'm thinking is this:
>>
>> Reduce nightly:
>> - Reduce ADT-REPO to just qemu* arches for all builds
>> - If every QA team could provide me a list of what files they actually
>> need I could reduce the published artifacts to *just* what is needed.
>>
>> Reduce releases:
>> - Reduce ADT-REPO to just qemu
>> - Don't release ipk/rpm/debs. Continue to release ipks through ADT
>> - Don't release machines outside of BSP tarball /binary directory
>>
>> If folks who do QA could get me a list of all the files they use, we
>> can start removing excess artifacts. I know this is a balance, but I'd
>> really like us to start targeting our release artifacts to just the
>> things we need.
>
> I fully agree on that.
>
> Is there anything you need specifically from me?
>
> --
> Otavio Salvador                             O.S. Systems
> http://www.ossystems.com.br        http://code.ossystems.com.br
> Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750



-- 
Elizabeth Flanagan
Yocto Project
Build and Release

Re: Reducing nightly/release build artifacts.

[Yi Zhao]

Hi Beth,


于 2014年03月27日 05:30, Flanagan, Elizabeth 写道:
> A list of exactly what files you use for QA would be grand.
>
> We can use http://autobuilder.yoctoproject.org/pub/nightly/20140326-1/
> as our base.

We don't use all qemu-lsb , beagleboard-lsb, routerstationpro-lsb, and 
p1022ds-lsb artifacts.
For the image type, we don't need minimal-dev and sato-dev.

Thanks,
Yi


>
> -b
>
> On Wed, Mar 26, 2014 at 2:22 PM, Otavio Salvador
> <otavio@ossystems.com.br> wrote:
>> Hello Beth,
>>
>> On Wed, Mar 26, 2014 at 6:14 PM, Flanagan, Elizabeth
>> <elizabeth.flanagan@intel.com> wrote:
>>> I'd like to start looking at reducing the number of artifacts we're
>>> releasing both for our nightly builds (which is at 250,000 artifacts
>>> and .25 TB!) and releases.
>>>
>>> What I'm thinking is this:
>>>
>>> Reduce nightly:
>>> - Reduce ADT-REPO to just qemu* arches for all builds
>>> - If every QA team could provide me a list of what files they actually
>>> need I could reduce the published artifacts to *just* what is needed.
>>>
>>> Reduce releases:
>>> - Reduce ADT-REPO to just qemu
>>> - Don't release ipk/rpm/debs. Continue to release ipks through ADT
>>> - Don't release machines outside of BSP tarball /binary directory
>>>
>>> If folks who do QA could get me a list of all the files they use, we
>>> can start removing excess artifacts. I know this is a balance, but I'd
>>> really like us to start targeting our release artifacts to just the
>>> things we need.
>> I fully agree on that.
>>
>> Is there anything you need specifically from me?
>>
>> --
>> Otavio Salvador                             O.S. Systems
>> http://www.ossystems.com.br        http://code.ossystems.com.br
>> Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750
>
>

Re: Reducing nightly/release build artifacts.

[Georgescu, Alexandru C]

Hi,
We need genericx86-64 lsb image. It is used for stress testing.

Regards,
--
Alexandru Georgescu

-----Original Message-----
From: Yi Zhao [mailto:yi.zhao@windriver.com] 
Sent: Friday, March 28, 2014 4:24 AM
To: Flanagan, Elizabeth
Cc: Otavio Salvador; yocto@yoctoproject.org; Georgescu, Alexandru C
Subject: Re: Reducing nightly/release build artifacts.

Hi Beth,


于 2014年03月27日 05:30, Flanagan, Elizabeth 写道:
> A list of exactly what files you use for QA would be grand.
>
> We can use http://autobuilder.yoctoproject.org/pub/nightly/20140326-1/
> as our base.

We don't use all qemu-lsb , beagleboard-lsb, routerstationpro-lsb, and p1022ds-lsb artifacts.
For the image type, we don't need minimal-dev and sato-dev.

Thanks,
Yi


>
> -b
>
> On Wed, Mar 26, 2014 at 2:22 PM, Otavio Salvador 
> <otavio@ossystems.com.br> wrote:
>> Hello Beth,
>>
>> On Wed, Mar 26, 2014 at 6:14 PM, Flanagan, Elizabeth 
>> <elizabeth.flanagan@intel.com> wrote:
>>> I'd like to start looking at reducing the number of artifacts we're 
>>> releasing both for our nightly builds (which is at 250,000 artifacts 
>>> and .25 TB!) and releases.
>>>
>>> What I'm thinking is this:
>>>
>>> Reduce nightly:
>>> - Reduce ADT-REPO to just qemu* arches for all builds
>>> - If every QA team could provide me a list of what files they 
>>> actually need I could reduce the published artifacts to *just* what is needed.
>>>
>>> Reduce releases:
>>> - Reduce ADT-REPO to just qemu
>>> - Don't release ipk/rpm/debs. Continue to release ipks through ADT
>>> - Don't release machines outside of BSP tarball /binary directory
>>>
>>> If folks who do QA could get me a list of all the files they use, we 
>>> can start removing excess artifacts. I know this is a balance, but 
>>> I'd really like us to start targeting our release artifacts to just 
>>> the things we need.
>> I fully agree on that.
>>
>> Is there anything you need specifically from me?
>>
>> --
>> Otavio Salvador                             O.S. Systems
>> http://www.ossystems.com.br        http://code.ossystems.com.br
>> Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750
>
>

Re: Reducing nightly/release build artifacts.

[Otavio Salvador]

Hello Beth,

On Wed, Mar 26, 2014 at 6:22 PM, Otavio Salvador
<otavio@ossystems.com.br> wrote:
> On Wed, Mar 26, 2014 at 6:14 PM, Flanagan, Elizabeth
> <elizabeth.flanagan@intel.com> wrote:
>> I'd like to start looking at reducing the number of artifacts we're
>> releasing both for our nightly builds (which is at 250,000 artifacts
>> and .25 TB!) and releases.

I don't use any meta-fsl-arm artifacts as I usually build the images
for testing, as does Daiane, however the autobuilder is critical for
me as your build does spot and exercise other things which mine does
not (plus the MUT) so I highly depend on it.

-- 
Otavio Salvador                             O.S. Systems
http://www.ossystems.com.br        http://code.ossystems.com.br
Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750

Re: Reducing nightly/release build artifacts.

[Flanagan, Elizabeth]

Otavio

So, if I were to not publish the fsl builds, would that be an issue?

-b

On Fri, Mar 28, 2014 at 6:02 AM, Otavio Salvador
<otavio@ossystems.com.br> wrote:
> Hello Beth,
>
> On Wed, Mar 26, 2014 at 6:22 PM, Otavio Salvador
> <otavio@ossystems.com.br> wrote:
>> On Wed, Mar 26, 2014 at 6:14 PM, Flanagan, Elizabeth
>> <elizabeth.flanagan@intel.com> wrote:
>>> I'd like to start looking at reducing the number of artifacts we're
>>> releasing both for our nightly builds (which is at 250,000 artifacts
>>> and .25 TB!) and releases.
>
> I don't use any meta-fsl-arm artifacts as I usually build the images
> for testing, as does Daiane, however the autobuilder is critical for
> me as your build does spot and exercise other things which mine does
> not (plus the MUT) so I highly depend on it.
>
> --
> Otavio Salvador                             O.S. Systems
> http://www.ossystems.com.br        http://code.ossystems.com.br
> Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750



-- 
Elizabeth Flanagan
Yocto Project
Build and Release

Re: Reducing nightly/release build artifacts.

[Otavio Salvador]

On Mon, Mar 31, 2014 at 3:38 PM, Flanagan, Elizabeth
<elizabeth.flanagan@intel.com> wrote:
> So, if I were to not publish the fsl builds, would that be an issue?

For me, it would work. In case I need something I can ask you to add
it back in future.

-- 
Otavio Salvador                             O.S. Systems
http://www.ossystems.com.br        http://code.ossystems.com.br
Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750

Re: Reducing nightly/release build artifacts.

[Yi Zhao]

Hi Beth,

于 2014年04月01日 02:38, Flanagan, Elizabeth 写道:
> Otavio
>
> So, if I were to not publish the fsl builds, would that be an issue?

Please do not remove p1022ds images from fsl-ppc build. I'm using it.

Thanks,
Yi

>
> -b
>
> On Fri, Mar 28, 2014 at 6:02 AM, Otavio Salvador
> <otavio@ossystems.com.br> wrote:
>> Hello Beth,
>>
>> On Wed, Mar 26, 2014 at 6:22 PM, Otavio Salvador
>> <otavio@ossystems.com.br> wrote:
>>> On Wed, Mar 26, 2014 at 6:14 PM, Flanagan, Elizabeth
>>> <elizabeth.flanagan@intel.com> wrote:
>>>> I'd like to start looking at reducing the number of artifacts we're
>>>> releasing both for our nightly builds (which is at 250,000 artifacts
>>>> and .25 TB!) and releases.
>> I don't use any meta-fsl-arm artifacts as I usually build the images
>> for testing, as does Daiane, however the autobuilder is critical for
>> me as your build does spot and exercise other things which mine does
>> not (plus the MUT) so I highly depend on it.
>>
>> --
>> Otavio Salvador                             O.S. Systems
>> http://www.ossystems.com.br        http://code.ossystems.com.br
>> Mobile: +55 (53) 9981-7854            Mobile: +1 (347) 903-9750
>
>