Re: upgrade:firefly-x:stress-split related workload

[Loic Dachary <loic@dachary.org>]

[-- Attachment #1: Type: text/plain, Size: 7697 bytes --]

Hi, 

The test suite finished at produced 5 errors, 4 of them in the "SWIFT_TEST_CONFIG_FILE" category

http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396882/
INFO:teuthology.orchestra.run.plana28.stderr:----------------------------------------------------------------------
2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last):
2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 104, in setUp
2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr:    cls.env.setUp()
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 140, in setUp
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:    raise ResponseError(cls.conn.response)
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:ResponseError: 500: Internal Server Error
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:======================================================================
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:FAIL: testGetRequest (test.functional.tests.TestAccountNoContainers)
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:----------------------------------------------------------------------
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last):
2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 325, in testGetRequest
2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr:    parms={'format':format}))
2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr:AssertionError: False is not true
2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr:
2014-08-04T10:54:48.140

http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396890/
INFO:teuthology.orchestra.run.plana64.stderr:======================================================================
2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:FAIL: testUtf8Container (test.functional.tests.TestContainerUTF8)
2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:----------------------------------------------------------------------
2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:Traceback (most recent call last):
2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 462, in testUtf8Container
2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr:    self.assert_(container.create(cfg={'no_path_quote':True}))
2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr:AssertionError: False is not true
2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr:
2014-08-04T12:51:21.583

http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396891/
INFO:teuthology.orchestra.run.plana12.stderr:======================================================================
2014-08-04T13:36:17.551 INFO:teuthology.orchestra.run.plana12.stderr:FAIL: testSerialization (test.functional.tests.TestFile)
2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:----------------------------------------------------------------------
2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:Traceback (most recent call last):
2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 1315, in testSerialization
2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:    self.assert_(container.create())
2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:AssertionError: False is not true
2014-08-04T13:36:17.553 INFO:teuthology.orchestra.run.plana12.stderr:
2014-08-04T13:36:17.553

http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396893/
INFO:teuthology.orchestra.run.plana34.stderr:======================================================================
2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:FAIL: testPrefixAndLimit (test.functional.tests.TestContainer)
2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:----------------------------------------------------------------------
2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:Traceback (most recent call last):
2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 415, in testPrefixAndLimit
2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr:    self.assert_(cont.create())
2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr:AssertionError: False is not true
2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr:
2014-08-04T12:59:44.079

one of them is because of a failed kill ceph-osd -f -i 5

http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396887/

which I suspect to be related to http://tracker.ceph.com/issues/8736

It strikes me as odd that all radosgw failures are different. As if something was preventing, randomly, the test to complete. Maybe a combination of running the test against a cluster that is stopped before the test can complete ? 

Cheers

On 04/08/2014 18:13, Yuri Weinstein wrote:
> Not yet.  I was wondering if you cold take a look after your run is
> completed (we had mane environment related and backport related
> issues, so we need to get trustworthy runs)?
> 
> But I did talk to Yehuda and logged
> http://tracker.ceph.com/issues/8988 which maybe covered a couple of
> them.
> 
> Thx
> YuriW
> 
> On Mon, Aug 4, 2014 at 9:07 AM, Loic Dachary <loic@dachary.org> wrote:
>>
>>
>> On 04/08/2014 16:54, Yuri Weinstein wrote:
>>> Sounds good, Loic.
>>>
>>> I ran 60 tests on vps -
>>> http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/
>>>
>>> I will need your help to see what to do about on ##
>>> http://tracker.ceph.com/issues/8736,
>>> http://tracker.ceph.com/issues/8737 and
>>> http://tracker.ceph.com/issues/8740
>>
>> Sure. Did you match them to errors from the 19 failures of http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/ ?
>>>
>>> Thx
>>> YuriW
>>>
>>> On Mon, Aug 4, 2014 at 6:11 AM, Loic Dachary <loic@dachary.org> wrote:
>>>> Hi Yuri,
>>>>
>>>> FYI I scheduled a upgrade:firefly-x:stress-split to check if http://tracker.ceph.com/issues/8475#note-14 behaves as expected http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/
>>>>
>>>> I'm hoping to see the same failures you have on master on next http://pulpito.ceph.com/teuthology-2014-07-30_13:09:01-upgrade:firefly-x:stress-split-next---basic-plana/
>>>>
>>>> Cheers
>>>> --
>>>> Loïc Dachary, Artisan Logiciel Libre
>>>>
>>
>> --
>> Loïc Dachary, Artisan Logiciel Libre
>>

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 263 bytes --]