* upgrade:firefly-x:stress-split related workload
@ 2014-08-04 13:11 Loic Dachary
[not found] ` <CAJBxG-sCN2DwpqyXqjLzUCTo-DvTBNVLQWzKPipCkMkZc=NFaw@mail.gmail.com>
0 siblings, 1 reply; 4+ messages in thread
From: Loic Dachary @ 2014-08-04 13:11 UTC (permalink / raw)
To: Yuri Weinstein; +Cc: Ceph Development
[-- Attachment #1: Type: text/plain, Size: 476 bytes --]
Hi Yuri,
FYI I scheduled a upgrade:firefly-x:stress-split to check if http://tracker.ceph.com/issues/8475#note-14 behaves as expected http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/
I'm hoping to see the same failures you have on master on next http://pulpito.ceph.com/teuthology-2014-07-30_13:09:01-upgrade:firefly-x:stress-split-next---basic-plana/
Cheers
--
Loïc Dachary, Artisan Logiciel Libre
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 263 bytes --]
^ permalink raw reply [flat|nested] 4+ messages in thread[parent not found: <CAJBxG-sCN2DwpqyXqjLzUCTo-DvTBNVLQWzKPipCkMkZc=NFaw@mail.gmail.com>]
[parent not found: <53DFAFA5.8040606@dachary.org>]
[parent not found: <CAJBxG-v-4mWTtdDvWhATpLHkjgozgQiFTt4hxw_s7CjWSyB=Sg@mail.gmail.com>]
* Re: upgrade:firefly-x:stress-split related workload [not found] ` <CAJBxG-v-4mWTtdDvWhATpLHkjgozgQiFTt4hxw_s7CjWSyB=Sg@mail.gmail.com> @ 2014-08-05 6:27 ` Loic Dachary [not found] ` <CAJBxG-tLnMitountCUWZ-A7sqpv=BrMyfW64uepbDH1w+dOurw@mail.gmail.com> 0 siblings, 1 reply; 4+ messages in thread From: Loic Dachary @ 2014-08-05 6:27 UTC (permalink / raw) To: Yuri Weinstein; +Cc: Ceph Development [-- Attachment #1: Type: text/plain, Size: 7697 bytes --] Hi, The test suite finished at produced 5 errors, 4 of them in the "SWIFT_TEST_CONFIG_FILE" category http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396882/ INFO:teuthology.orchestra.run.plana28.stderr:---------------------------------------------------------------------- 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last): 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 104, in setUp 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr: cls.env.setUp() 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 140, in setUp 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: raise ResponseError(cls.conn.response) 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:ResponseError: 500: Internal Server Error 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:====================================================================== 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:FAIL: testGetRequest (test.functional.tests.TestAccountNoContainers) 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:---------------------------------------------------------------------- 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last): 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 325, in testGetRequest 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr: parms={'format':format})) 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr:AssertionError: False is not true 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr: 2014-08-04T10:54:48.140 http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396890/ INFO:teuthology.orchestra.run.plana64.stderr:====================================================================== 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:FAIL: testUtf8Container (test.functional.tests.TestContainerUTF8) 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:---------------------------------------------------------------------- 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:Traceback (most recent call last): 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 462, in testUtf8Container 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: self.assert_(container.create(cfg={'no_path_quote':True})) 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr:AssertionError: False is not true 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: 2014-08-04T12:51:21.583 http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396891/ INFO:teuthology.orchestra.run.plana12.stderr:====================================================================== 2014-08-04T13:36:17.551 INFO:teuthology.orchestra.run.plana12.stderr:FAIL: testSerialization (test.functional.tests.TestFile) 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:---------------------------------------------------------------------- 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:Traceback (most recent call last): 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 1315, in testSerialization 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr: self.assert_(container.create()) 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:AssertionError: False is not true 2014-08-04T13:36:17.553 INFO:teuthology.orchestra.run.plana12.stderr: 2014-08-04T13:36:17.553 http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396893/ INFO:teuthology.orchestra.run.plana34.stderr:====================================================================== 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:FAIL: testPrefixAndLimit (test.functional.tests.TestContainer) 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:---------------------------------------------------------------------- 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:Traceback (most recent call last): 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 415, in testPrefixAndLimit 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr: self.assert_(cont.create()) 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr:AssertionError: False is not true 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr: 2014-08-04T12:59:44.079 one of them is because of a failed kill ceph-osd -f -i 5 http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396887/ which I suspect to be related to http://tracker.ceph.com/issues/8736 It strikes me as odd that all radosgw failures are different. As if something was preventing, randomly, the test to complete. Maybe a combination of running the test against a cluster that is stopped before the test can complete ? Cheers On 04/08/2014 18:13, Yuri Weinstein wrote: > Not yet. I was wondering if you cold take a look after your run is > completed (we had mane environment related and backport related > issues, so we need to get trustworthy runs)? > > But I did talk to Yehuda and logged > http://tracker.ceph.com/issues/8988 which maybe covered a couple of > them. > > Thx > YuriW > > On Mon, Aug 4, 2014 at 9:07 AM, Loic Dachary <loic@dachary.org> wrote: >> >> >> On 04/08/2014 16:54, Yuri Weinstein wrote: >>> Sounds good, Loic. >>> >>> I ran 60 tests on vps - >>> http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/ >>> >>> I will need your help to see what to do about on ## >>> http://tracker.ceph.com/issues/8736, >>> http://tracker.ceph.com/issues/8737 and >>> http://tracker.ceph.com/issues/8740 >> >> Sure. Did you match them to errors from the 19 failures of http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/ ? >>> >>> Thx >>> YuriW >>> >>> On Mon, Aug 4, 2014 at 6:11 AM, Loic Dachary <loic@dachary.org> wrote: >>>> Hi Yuri, >>>> >>>> FYI I scheduled a upgrade:firefly-x:stress-split to check if http://tracker.ceph.com/issues/8475#note-14 behaves as expected http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/ >>>> >>>> I'm hoping to see the same failures you have on master on next http://pulpito.ceph.com/teuthology-2014-07-30_13:09:01-upgrade:firefly-x:stress-split-next---basic-plana/ >>>> >>>> Cheers >>>> -- >>>> Loïc Dachary, Artisan Logiciel Libre >>>> >> >> -- >> Loïc Dachary, Artisan Logiciel Libre >> -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 263 bytes --] ^ permalink raw reply [flat|nested] 4+ messages in thread
[parent not found: <CAJBxG-tLnMitountCUWZ-A7sqpv=BrMyfW64uepbDH1w+dOurw@mail.gmail.com>]
[parent not found: <CAJBxG-u8mc-UtdzyL8Qx6w_PU7mw06sqvtN5PJaUUAPJTOHzTA@mail.gmail.com>]
[parent not found: <CAJBxG-sTXRrCM12v5y867P7GPrar_rp0ULvZMg_q-OKhCp8Ctw@mail.gmail.com>]
* Re: upgrade:firefly-x:stress-split related workload [not found] ` <CAJBxG-sTXRrCM12v5y867P7GPrar_rp0ULvZMg_q-OKhCp8Ctw@mail.gmail.com> @ 2014-08-05 19:29 ` Loic Dachary 2014-08-05 19:35 ` Loic Dachary 0 siblings, 1 reply; 4+ messages in thread From: Loic Dachary @ 2014-08-05 19:29 UTC (permalink / raw) To: Yuri Weinstein; +Cc: Ceph Development [-- Attachment #1: Type: text/plain, Size: 9238 bytes --] Hi Yuri, It already has an ec_pool workload at https://github.com/ceph/ceph-qa-suite/blob/master/suites/upgrade/firefly-x/stress-split/5-workload/ec-readwrite.yaml Cheers On 05/08/2014 19:25, Yuri Weinstein wrote: > BTW, I have a suite upgrade/dumpling-firefly-x, which all passed yesterday. > > How can EC be enabled for it? Do you want to try EC on it? > > Thx > YuriW > > On Tue, Aug 5, 2014 at 10:05 AM, Yuri Weinstein > <yuri.weinstein@inktank.com> wrote: >> What is really disappointing when failed tests pass - 396983 passed. >> >> ??? >> >> On Tue, Aug 5, 2014 at 8:26 AM, Yuri Weinstein >> <yuri.weinstein@inktank.com> wrote: >>> Yeah, that's possible. >>> >>> I am re-trying manually now 396893 >>> (http://qa-proxy.ceph.com/teuthology/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396893/orig.config.yaml) >>> >>> On Mon, Aug 4, 2014 at 11:27 PM, Loic Dachary <loic@dachary.org> wrote: >>>> Hi, >>>> >>>> The test suite finished at produced 5 errors, 4 of them in the "SWIFT_TEST_CONFIG_FILE" category >>>> >>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396882/ >>>> INFO:teuthology.orchestra.run.plana28.stderr:---------------------------------------------------------------------- >>>> 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last): >>>> 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 104, in setUp >>>> 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr: cls.env.setUp() >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 140, in setUp >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: raise ResponseError(cls.conn.response) >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:ResponseError: 500: Internal Server Error >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:====================================================================== >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:FAIL: testGetRequest (test.functional.tests.TestAccountNoContainers) >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:---------------------------------------------------------------------- >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last): >>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 325, in testGetRequest >>>> 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr: parms={'format':format})) >>>> 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr:AssertionError: False is not true >>>> 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr: >>>> 2014-08-04T10:54:48.140 >>>> >>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396890/ >>>> INFO:teuthology.orchestra.run.plana64.stderr:====================================================================== >>>> 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:FAIL: testUtf8Container (test.functional.tests.TestContainerUTF8) >>>> 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:---------------------------------------------------------------------- >>>> 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:Traceback (most recent call last): >>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 462, in testUtf8Container >>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: self.assert_(container.create(cfg={'no_path_quote':True})) >>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr:AssertionError: False is not true >>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: >>>> 2014-08-04T12:51:21.583 >>>> >>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396891/ >>>> INFO:teuthology.orchestra.run.plana12.stderr:====================================================================== >>>> 2014-08-04T13:36:17.551 INFO:teuthology.orchestra.run.plana12.stderr:FAIL: testSerialization (test.functional.tests.TestFile) >>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:---------------------------------------------------------------------- >>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:Traceback (most recent call last): >>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 1315, in testSerialization >>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr: self.assert_(container.create()) >>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:AssertionError: False is not true >>>> 2014-08-04T13:36:17.553 INFO:teuthology.orchestra.run.plana12.stderr: >>>> 2014-08-04T13:36:17.553 >>>> >>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396893/ >>>> INFO:teuthology.orchestra.run.plana34.stderr:====================================================================== >>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:FAIL: testPrefixAndLimit (test.functional.tests.TestContainer) >>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:---------------------------------------------------------------------- >>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:Traceback (most recent call last): >>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 415, in testPrefixAndLimit >>>> 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr: self.assert_(cont.create()) >>>> 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr:AssertionError: False is not true >>>> 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr: >>>> 2014-08-04T12:59:44.079 >>>> >>>> one of them is because of a failed kill ceph-osd -f -i 5 >>>> >>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396887/ >>>> >>>> which I suspect to be related to http://tracker.ceph.com/issues/8736 >>>> >>>> It strikes me as odd that all radosgw failures are different. As if something was preventing, randomly, the test to complete. Maybe a combination of running the test against a cluster that is stopped before the test can complete ? >>>> >>>> Cheers >>>> >>>> On 04/08/2014 18:13, Yuri Weinstein wrote: >>>>> Not yet. I was wondering if you cold take a look after your run is >>>>> completed (we had mane environment related and backport related >>>>> issues, so we need to get trustworthy runs)? >>>>> >>>>> But I did talk to Yehuda and logged >>>>> http://tracker.ceph.com/issues/8988 which maybe covered a couple of >>>>> them. >>>>> >>>>> Thx >>>>> YuriW >>>>> >>>>> On Mon, Aug 4, 2014 at 9:07 AM, Loic Dachary <loic@dachary.org> wrote: >>>>>> >>>>>> >>>>>> On 04/08/2014 16:54, Yuri Weinstein wrote: >>>>>>> Sounds good, Loic. >>>>>>> >>>>>>> I ran 60 tests on vps - >>>>>>> http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/ >>>>>>> >>>>>>> I will need your help to see what to do about on ## >>>>>>> http://tracker.ceph.com/issues/8736, >>>>>>> http://tracker.ceph.com/issues/8737 and >>>>>>> http://tracker.ceph.com/issues/8740 >>>>>> >>>>>> Sure. Did you match them to errors from the 19 failures of http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/ ? >>>>>>> >>>>>>> Thx >>>>>>> YuriW >>>>>>> >>>>>>> On Mon, Aug 4, 2014 at 6:11 AM, Loic Dachary <loic@dachary.org> wrote: >>>>>>>> Hi Yuri, >>>>>>>> >>>>>>>> FYI I scheduled a upgrade:firefly-x:stress-split to check if http://tracker.ceph.com/issues/8475#note-14 behaves as expected http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/ >>>>>>>> >>>>>>>> I'm hoping to see the same failures you have on master on next http://pulpito.ceph.com/teuthology-2014-07-30_13:09:01-upgrade:firefly-x:stress-split-next---basic-plana/ >>>>>>>> >>>>>>>> Cheers >>>>>>>> -- >>>>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>>>> >>>>>> >>>>>> -- >>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>> >>>> >>>> -- >>>> Loïc Dachary, Artisan Logiciel Libre >>>> -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 263 bytes --] ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: upgrade:firefly-x:stress-split related workload 2014-08-05 19:29 ` Loic Dachary @ 2014-08-05 19:35 ` Loic Dachary 0 siblings, 0 replies; 4+ messages in thread From: Loic Dachary @ 2014-08-05 19:35 UTC (permalink / raw) To: Yuri Weinstein; +Cc: Ceph Development [-- Attachment #1: Type: text/plain, Size: 9896 bytes --] Please ignore me : I misread the *dumpling* ;-) I guess copying the https://github.com/ceph/ceph-qa-suite/blob/master/suites/upgrade/firefly-x/stress-split/5-workload/ec-readwrite.yaml somewhere in the dumpling-firefly-x, after the upgrade, would demonstrate it is able to create and use an erasure coded pool. More importantly it will also show that the bug http://tracker.ceph.com/issues/8601 actually is fixed and backported. Good idea ! On 05/08/2014 21:29, Loic Dachary wrote: > Hi Yuri, > > It already has an ec_pool workload at > > https://github.com/ceph/ceph-qa-suite/blob/master/suites/upgrade/firefly-x/stress-split/5-workload/ec-readwrite.yaml > > Cheers > > On 05/08/2014 19:25, Yuri Weinstein wrote: >> BTW, I have a suite upgrade/dumpling-firefly-x, which all passed yesterday. >> >> How can EC be enabled for it? Do you want to try EC on it? >> >> Thx >> YuriW >> >> On Tue, Aug 5, 2014 at 10:05 AM, Yuri Weinstein >> <yuri.weinstein@inktank.com> wrote: >>> What is really disappointing when failed tests pass - 396983 passed. >>> >>> ??? >>> >>> On Tue, Aug 5, 2014 at 8:26 AM, Yuri Weinstein >>> <yuri.weinstein@inktank.com> wrote: >>>> Yeah, that's possible. >>>> >>>> I am re-trying manually now 396893 >>>> (http://qa-proxy.ceph.com/teuthology/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396893/orig.config.yaml) >>>> >>>> On Mon, Aug 4, 2014 at 11:27 PM, Loic Dachary <loic@dachary.org> wrote: >>>>> Hi, >>>>> >>>>> The test suite finished at produced 5 errors, 4 of them in the "SWIFT_TEST_CONFIG_FILE" category >>>>> >>>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396882/ >>>>> INFO:teuthology.orchestra.run.plana28.stderr:---------------------------------------------------------------------- >>>>> 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last): >>>>> 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 104, in setUp >>>>> 2014-08-04T10:54:48.138 INFO:teuthology.orchestra.run.plana28.stderr: cls.env.setUp() >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 140, in setUp >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: raise ResponseError(cls.conn.response) >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:ResponseError: 500: Internal Server Error >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:====================================================================== >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:FAIL: testGetRequest (test.functional.tests.TestAccountNoContainers) >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:---------------------------------------------------------------------- >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr:Traceback (most recent call last): >>>>> 2014-08-04T10:54:48.139 INFO:teuthology.orchestra.run.plana28.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 325, in testGetRequest >>>>> 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr: parms={'format':format})) >>>>> 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr:AssertionError: False is not true >>>>> 2014-08-04T10:54:48.140 INFO:teuthology.orchestra.run.plana28.stderr: >>>>> 2014-08-04T10:54:48.140 >>>>> >>>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396890/ >>>>> INFO:teuthology.orchestra.run.plana64.stderr:====================================================================== >>>>> 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:FAIL: testUtf8Container (test.functional.tests.TestContainerUTF8) >>>>> 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:---------------------------------------------------------------------- >>>>> 2014-08-04T12:51:21.582 INFO:teuthology.orchestra.run.plana64.stderr:Traceback (most recent call last): >>>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 462, in testUtf8Container >>>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: self.assert_(container.create(cfg={'no_path_quote':True})) >>>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr:AssertionError: False is not true >>>>> 2014-08-04T12:51:21.583 INFO:teuthology.orchestra.run.plana64.stderr: >>>>> 2014-08-04T12:51:21.583 >>>>> >>>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396891/ >>>>> INFO:teuthology.orchestra.run.plana12.stderr:====================================================================== >>>>> 2014-08-04T13:36:17.551 INFO:teuthology.orchestra.run.plana12.stderr:FAIL: testSerialization (test.functional.tests.TestFile) >>>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:---------------------------------------------------------------------- >>>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:Traceback (most recent call last): >>>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 1315, in testSerialization >>>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr: self.assert_(container.create()) >>>>> 2014-08-04T13:36:17.552 INFO:teuthology.orchestra.run.plana12.stderr:AssertionError: False is not true >>>>> 2014-08-04T13:36:17.553 INFO:teuthology.orchestra.run.plana12.stderr: >>>>> 2014-08-04T13:36:17.553 >>>>> >>>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396893/ >>>>> INFO:teuthology.orchestra.run.plana34.stderr:====================================================================== >>>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:FAIL: testPrefixAndLimit (test.functional.tests.TestContainer) >>>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:---------------------------------------------------------------------- >>>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr:Traceback (most recent call last): >>>>> 2014-08-04T12:59:44.078 INFO:teuthology.orchestra.run.plana34.stderr: File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 415, in testPrefixAndLimit >>>>> 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr: self.assert_(cont.create()) >>>>> 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr:AssertionError: False is not true >>>>> 2014-08-04T12:59:44.079 INFO:teuthology.orchestra.run.plana34.stderr: >>>>> 2014-08-04T12:59:44.079 >>>>> >>>>> one of them is because of a failed kill ceph-osd -f -i 5 >>>>> >>>>> http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/396887/ >>>>> >>>>> which I suspect to be related to http://tracker.ceph.com/issues/8736 >>>>> >>>>> It strikes me as odd that all radosgw failures are different. As if something was preventing, randomly, the test to complete. Maybe a combination of running the test against a cluster that is stopped before the test can complete ? >>>>> >>>>> Cheers >>>>> >>>>> On 04/08/2014 18:13, Yuri Weinstein wrote: >>>>>> Not yet. I was wondering if you cold take a look after your run is >>>>>> completed (we had mane environment related and backport related >>>>>> issues, so we need to get trustworthy runs)? >>>>>> >>>>>> But I did talk to Yehuda and logged >>>>>> http://tracker.ceph.com/issues/8988 which maybe covered a couple of >>>>>> them. >>>>>> >>>>>> Thx >>>>>> YuriW >>>>>> >>>>>> On Mon, Aug 4, 2014 at 9:07 AM, Loic Dachary <loic@dachary.org> wrote: >>>>>>> >>>>>>> >>>>>>> On 04/08/2014 16:54, Yuri Weinstein wrote: >>>>>>>> Sounds good, Loic. >>>>>>>> >>>>>>>> I ran 60 tests on vps - >>>>>>>> http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/ >>>>>>>> >>>>>>>> I will need your help to see what to do about on ## >>>>>>>> http://tracker.ceph.com/issues/8736, >>>>>>>> http://tracker.ceph.com/issues/8737 and >>>>>>>> http://tracker.ceph.com/issues/8740 >>>>>>> >>>>>>> Sure. Did you match them to errors from the 19 failures of http://pulpito.front.sepia.ceph.com/teuthology-2014-08-03_16:05:01-upgrade:firefly-x:stress-split-next---basic-vps/ ? >>>>>>>> >>>>>>>> Thx >>>>>>>> YuriW >>>>>>>> >>>>>>>> On Mon, Aug 4, 2014 at 6:11 AM, Loic Dachary <loic@dachary.org> wrote: >>>>>>>>> Hi Yuri, >>>>>>>>> >>>>>>>>> FYI I scheduled a upgrade:firefly-x:stress-split to check if http://tracker.ceph.com/issues/8475#note-14 behaves as expected http://pulpito.ceph.com/loic-2014-08-04_15:06:02-upgrade:firefly-x:stress-split-wip-8475-testing-basic-plana/ >>>>>>>>> >>>>>>>>> I'm hoping to see the same failures you have on master on next http://pulpito.ceph.com/teuthology-2014-07-30_13:09:01-upgrade:firefly-x:stress-split-next---basic-plana/ >>>>>>>>> >>>>>>>>> Cheers >>>>>>>>> -- >>>>>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>>> >>>>> >>>>> -- >>>>> Loïc Dachary, Artisan Logiciel Libre >>>>> > -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 263 bytes --] ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2014-08-05 19:35 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-08-04 13:11 upgrade:firefly-x:stress-split related workload Loic Dachary
[not found] ` <CAJBxG-sCN2DwpqyXqjLzUCTo-DvTBNVLQWzKPipCkMkZc=NFaw@mail.gmail.com>
[not found] ` <53DFAFA5.8040606@dachary.org>
[not found] ` <CAJBxG-v-4mWTtdDvWhATpLHkjgozgQiFTt4hxw_s7CjWSyB=Sg@mail.gmail.com>
2014-08-05 6:27 ` Loic Dachary
[not found] ` <CAJBxG-tLnMitountCUWZ-A7sqpv=BrMyfW64uepbDH1w+dOurw@mail.gmail.com>
[not found] ` <CAJBxG-u8mc-UtdzyL8Qx6w_PU7mw06sqvtN5PJaUUAPJTOHzTA@mail.gmail.com>
[not found] ` <CAJBxG-sTXRrCM12v5y867P7GPrar_rp0ULvZMg_q-OKhCp8Ctw@mail.gmail.com>
2014-08-05 19:29 ` Loic Dachary
2014-08-05 19:35 ` Loic Dachary
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.