Re: [Ceph-qa] 1 hung, 11 passed in teuthology-2015-02-11_16:13:01-samba-giant-distro-basic-multi

[Loic Dachary <loic@dachary.org>]

[-- Attachment #1: Type: text/plain, Size: 1468 bytes --]



On 14/02/2015 08:56, Gregory Farnum wrote:
> On Fri, Feb 13, 2015 at 10:34 PM, Loic Dachary <loic@dachary.org> wrote:
>> Hi Greg,
>>
>> I'm curious to know how you handle the flow of mails from QA runs. Here is a wild guess:
>>
>> * from time to time check that the nightlies run the suites that should be run
> 
> Uh, I guess?
> 
>> * read the ceph-qa reports daily
> 
> Yeah
> 
>> * for each failed job, either relate it to an issue or create one or declare it noise
> 
> Yeah
> 
>> * if a job fails on an existing ticket store a link to the job if it's rare occurrence and the cause is not yet known
> 
> Yeah, or just to make clear it's still happening or whatever
> 
>> * bi-weekly bug scrub makes sure no issue, old or new, is forgotten
> 
> Hopefully!
> 
>> * at release time you decide that it is ready based on:
>> ** the list of urgent/immediate issues that you can browse to ensure no issue is a blocker
>> ** the last run of each suite to ensure they are recent enough and environmental noise did not permanently shadow anything
> 
> Yeah. Well, the last run alone isn't so important; we want to see a
> string of clean runs because a lot of issues aren't reproduced in
> every run.

Do you check the string of clean runs with http://pulpito.ceph.com/?suite=fs&branch=giant for instance ? Or do you have a command line that does the same ?

Cheers

> -Greg
> 
> 

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]