Publishing development releases

Publishing development releases

[Loic Dachary]

Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,

A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.

This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:

1. ensure that the community's demand for development releases is met
2. complement, not replace, the existing package publication workflow
3. be automated.

So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:

             ceph-workbench release --suite buildpackages/any \
                         --ceph jewel \
                         --version 10.0.5 \
                         --filter ubuntu_14.04,centos_7.2

When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com.

I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.

Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?

Cheers

[1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
[2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
[3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232

-- 
Loïc Dachary, Artisan Logiciel Libre
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Publishing development releases

[Martin Palma]

Hi all,

I'm OK with that and I personally think it is good to provide also
development releases to the community, which in the end will lead to a
broader testing before the actual release.

Best,
Martin

On Tue, Mar 15, 2016 at 10:13 AM, Loic Dachary <loic@dachary.org> wrote:
> Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,
>
> A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.
>
> This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:
>
> 1. ensure that the community's demand for development releases is met
> 2. complement, not replace, the existing package publication workflow
> 3. be automated.
>
> So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:
>
>              ceph-workbench release --suite buildpackages/any \
>                          --ceph jewel \
>                          --version 10.0.5 \
>                          --filter ubuntu_14.04,centos_7.2
>
> When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com.
>
> I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.
>
> Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?
>
> Cheers
>
> [1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
> [2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
> [3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232
>
> --
> Loïc Dachary, Artisan Logiciel Libre
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Publishing development releases

[Nathan Cutler]

Hi Loic:

I, too, think this is a good idea and am willing to accept the extra 
workload.

Nathan

On 03/15/2016 10:13 AM, Loic Dachary wrote:
> Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,
>
> A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.
>
> This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:
>
> 1. ensure that the community's demand for development releases is met
> 2. complement, not replace, the existing package publication workflow
> 3. be automated.
>
> So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:
>
>               ceph-workbench release --suite buildpackages/any \
>                           --ceph jewel \
>                           --version 10.0.5 \
>                           --filter ubuntu_14.04,centos_7.2
>
> When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com.
>
> I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.
>
> Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?
>
> Cheers
>
> [1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
> [2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
> [3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232
>


-- 
Nathan Cutler
Software Engineer Distributed Storage
SUSE LINUX, s.r.o.
Tel.: +420 284 084 037

Re: Publishing development releases

[Loic Dachary]

On 16/03/2016 03:44, Wei-Chung Cheng wrote:
> Hi loic:
> 
> agree!
> I think that is a good idea and would be helpful for our formal release.
> Also glad to accept the extra workload.
> 
> btw, I could not see the `http://pad.ceph.com/p/development-releases` content.
> would I need to do something?

http://pad.ceph.com/p/development-releases

(there is an extra ` at the end that leads to a different document ;-)

> 
> thanks!!
> vicente
> 
> 
> 2016-03-16 4:31 GMT+08:00 Nathan Cutler <ncutler@suse.cz <mailto:ncutler@suse.cz>>:
> 
>     Hi Loic:
> 
>     I, too, think this is a good idea and am willing to accept the extra workload.
> 
>     Nathan
> 
> 
>     On 03/15/2016 10:13 AM, Loic Dachary wrote:
> 
>         Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,
> 
>         A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.
> 
>         This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:
> 
>         1. ensure that the community's demand for development releases is met
>         2. complement, not replace, the existing package publication workflow
>         3. be automated.
> 
>         So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:
> 
>                       ceph-workbench release --suite buildpackages/any \
>                                   --ceph jewel \
>                                   --version 10.0.5 \
>                                   --filter ubuntu_14.04,centos_7.2
> 
>         When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com <http://downloads.ceph.com>.
> 
>         I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.
> 
>         Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?
> 
>         Cheers
> 
>         [1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
>         [2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
>         [3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232
> 
> 
> 
>     -- 
>     Nathan Cutler
>     Software Engineer Distributed Storage
>     SUSE LINUX, s.r.o.
>     Tel.: +420 284 084 037 <tel:%2B420%20284%20084%20037>
> 
> 

-- 
Loïc Dachary, Artisan Logiciel Libre
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Publishing development releases

[Abhishek Lekshmanan]

Nathan Cutler writes:

> Hi Loic:
>
> I, too, think this is a good idea and am willing to accept the extra
> workload.
>
> Nathan

+1 I also agree, and it would be a benefit for the community as well.

Abhishek
>
> On 03/15/2016 10:13 AM, Loic Dachary wrote:
>> Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,
>>
>> A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.
>>
>> This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:
>>
>> 1. ensure that the community's demand for development releases is met
>> 2. complement, not replace, the existing package publication workflow
>> 3. be automated.
>>
>> So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:
>>
>>               ceph-workbench release --suite buildpackages/any \
>>                           --ceph jewel \
>>                           --version 10.0.5 \
>>                           --filter ubuntu_14.04,centos_7.2
>>
>> When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com.
>>
>> I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.
>>
>> Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?
>>
>> Cheers
>>
>> [1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
>> [2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
>> [3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232
>>
>
>
> --
> Nathan Cutler
> Software Engineer Distributed Storage
> SUSE LINUX, s.r.o.
> Tel.: +420 284 084 037

Re: Publishing development releases

[Abhishek Varshney]

+ ceph-devel, in plain-text now.

On Wed, Mar 16, 2016 at 2:59 PM, Abhishek Varshney
<abhishek.varshney@flipkart.com> wrote:
>
> I am in too. Lets do it :)
>
> Abhishek
>
>
> On Wed, Mar 16, 2016 at 2:13 PM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
>>
>>
>> Nathan Cutler writes:
>>
>> > Hi Loic:
>> >
>> > I, too, think this is a good idea and am willing to accept the extra
>> > workload.
>> >
>> > Nathan
>>
>> +1 I also agree, and it would be a benefit for the community as well.
>>
>> Abhishek
>> >
>> > On 03/15/2016 10:13 AM, Loic Dachary wrote:
>> >> Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,
>> >>
>> >> A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.
>> >>
>> >> This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:
>> >>
>> >> 1. ensure that the community's demand for development releases is met
>> >> 2. complement, not replace, the existing package publication workflow
>> >> 3. be automated.
>> >>
>> >> So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:
>> >>
>> >>               ceph-workbench release --suite buildpackages/any \
>> >>                           --ceph jewel \
>> >>                           --version 10.0.5 \
>> >>                           --filter ubuntu_14.04,centos_7.2
>> >>
>> >> When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com.
>> >>
>> >> I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.
>> >>
>> >> Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?
>> >>
>> >> Cheers
>> >>
>> >> [1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
>> >> [2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
>> >> [3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232
>> >>
>> >
>> >
>> > --
>> > Nathan Cutler
>> > Software Engineer Distributed Storage
>> > SUSE LINUX, s.r.o.
>> > Tel.: +420 284 084 037
>>
>

Re: Publishing development releases

[M Ranga Swami Reddy]

+1 from my side.

Thanks
Swami


On Wed, Mar 16, 2016 at 3:27 PM, Abhishek Varshney
<abhishek.varshney@flipkart.com> wrote:
> + ceph-devel, in plain-text now.
>
> On Wed, Mar 16, 2016 at 2:59 PM, Abhishek Varshney
> <abhishek.varshney@flipkart.com> wrote:
>>
>> I am in too. Lets do it :)
>>
>> Abhishek
>>
>>
>> On Wed, Mar 16, 2016 at 2:13 PM, Abhishek Lekshmanan <abhishek@suse.com> wrote:
>>>
>>>
>>> Nathan Cutler writes:
>>>
>>> > Hi Loic:
>>> >
>>> > I, too, think this is a good idea and am willing to accept the extra
>>> > workload.
>>> >
>>> > Nathan
>>>
>>> +1 I also agree, and it would be a benefit for the community as well.
>>>
>>> Abhishek
>>> >
>>> > On 03/15/2016 10:13 AM, Loic Dachary wrote:
>>> >> Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,
>>> >>
>>> >> A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.
>>> >>
>>> >> This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:
>>> >>
>>> >> 1. ensure that the community's demand for development releases is met
>>> >> 2. complement, not replace, the existing package publication workflow
>>> >> 3. be automated.
>>> >>
>>> >> So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:
>>> >>
>>> >>               ceph-workbench release --suite buildpackages/any \
>>> >>                           --ceph jewel \
>>> >>                           --version 10.0.5 \
>>> >>                           --filter ubuntu_14.04,centos_7.2
>>> >>
>>> >> When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com.
>>> >>
>>> >> I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.
>>> >>
>>> >> Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?
>>> >>
>>> >> Cheers
>>> >>
>>> >> [1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
>>> >> [2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
>>> >> [3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232
>>> >>
>>> >
>>> >
>>> > --
>>> > Nathan Cutler
>>> > Software Engineer Distributed Storage
>>> > SUSE LINUX, s.r.o.
>>> > Tel.: +420 284 084 037
>>>
>>
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Re: Publishing development releases

[Loic Dachary]

Hi,

It looks like we have a majority in favor, let's do it :-)

I took the first round with the publication of 10.0.5. Our rotation schedule was updated to add 10.1.0 (the next development release) http://tracker.ceph.com/projects/ceph-releases/wiki/HOWTO#Whos-who and I set myself as a backup. If someone is willing to learn how to publish a dev release, I'll be happy to explain. It is now documented at http://tracker.ceph.com/projects/ceph-releases/wiki/HOWTO_publish_a_release. There is no doubt things are missing but they can be fixed / documented as we make progress.

Cheers

On 15/03/2016 10:13, Loic Dachary wrote:
> Hi Abhishek V, Abhishek L, Swami, Nathan, Gaurav, Rajat, Martin, Xiaoxi, Vicente,
> 
> A few weeks ago, 10.0.3 was tagged for release, but packages were not published and these packages were missed by the Ceph user base. We, the members of the Stable Releases team, got to thinking how we could help.
> 
> This led to an idea that was discussed on the mailing list[1] and during CDM[2]. Since we were already building packages as a side effect of running teuthology suites on OpenStack, this could be extended into a full-fledged release process that would:
> 
> 1. ensure that the community's demand for development releases is met
> 2. complement, not replace, the existing package publication workflow
> 3. be automated.
> 
> So I added a "release" subcommand to the ceph-workbench[3] tool we are already using to automate various backporting tasks. The new subcommand is included in the latest ceph-workbench release, and works like this:
> 
>              ceph-workbench release --suite buildpackages/any \
>                          --ceph jewel \
>                          --version 10.0.5 \
>                          --filter ubuntu_14.04,centos_7.2
> 
> When it completes the packages can be uploaded to a permanent mirror similar to downloads.ceph.com.
> 
> I believe we can commit to publish Ceph development releases with this process. The "release" subcommand is relatively small (around 300 lines of code) and there are integration tests to help with its maintenance. There are enough of us to rotate the release duties so that it does not become too much of a burden for anyone.
> 
> Since it's a decision that changes our focus and our workload, are you OK with adding this activity to the scope of our team?
> 
> Cheers
> 
> [1] (Un)Stable release team http://www.spinics.net/lists/ceph-devel/msg28887.html
> [2] publishing development and unsupported releases http://tracker.ceph.com/projects/ceph/wiki/CDM_02-MAR-2016
> [3] ceph-workbench release merge request http://ceph-workbench.dachary.org/root/ceph-workbench/merge_requests/43/diffs#9f3ebf1fc38506b66593397f3baac514d515c496_231_232

-- 
Loïc Dachary, Artisan Logiciel Libre
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html