* Re: Teuthology Integration to native openstack [not found] <D22E3F64.15AF%bkrishna@walmartlabs.com> @ 2015-09-27 20:17 ` Loic Dachary 2015-09-28 5:24 ` Bharath Krishna 0 siblings, 1 reply; 10+ messages in thread From: Loic Dachary @ 2015-09-27 20:17 UTC (permalink / raw) To: Bharath Krishna, Ceph Development [-- Attachment #1: Type: text/plain, Size: 1131 bytes --] [moving to ceph-devel] Hi, On 27/09/2015 21:20, Bharath Krishna wrote: > Hi, > > We have an openstack deployment in place with CEPH as CINDER backend. > > We would like to perform functional testing for CEPH and found teuthology as recommended option. > > Have successfully installed teuthology. Now to integrate it with Openstack, I could see that the possible providers could be either OVH, REDHAT or ENTERCLOUDSITE. > > Is there any option where in we can source openstack deployment of our own and test CEPH using teuthology? The documentation mentions these providers because they have been tested. But there should be no blocker to run teuthology against a regular OpenStack provider. Should you run into troubles, please let me know and I'll help. Cheers > > If NO, please suggest on how to test CEPH in such scenarios? > > Please help. > > Thank you. > Bharath Krishna > _______________________________________________ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 198 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-27 20:17 ` Teuthology Integration to native openstack Loic Dachary @ 2015-09-28 5:24 ` Bharath Krishna 2015-09-28 9:50 ` Loic Dachary 0 siblings, 1 reply; 10+ messages in thread From: Bharath Krishna @ 2015-09-28 5:24 UTC (permalink / raw) To: Loic Dachary, Ceph Development Hi Dachary, Thanks for the reply. I am following your blog http://dachary.org/?p=3767 And the README in https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#openstack -backend I have sourced the openrc file of my Openstack deployment and verified that clients are working fine. My Openstack deployment has Cinder integrated with CEPH backend. I have cloned and installed teuthology using the below steps: $ git clone -b wip-6502-openstack-v2 http://github.com/dachary/teuthology $ cd teuthology ; ./bootstrap install $ source virtualenv/bin/activate Then I tried to run a dummy suite as test and I ran into following error: Traceback (most recent call last): File "/root/teuthology/virtualenv/bin/teuthology-openstack", line 9, in <module> load_entry_point('teuthology==0.1.0', 'console_scripts', 'teuthology-openstack')() File "/root/teuthology/scripts/openstack.py", line 8, in main teuthology.openstack.main(parse_args(argv), argv) File "/root/teuthology/teuthology/openstack.py", line 375, in main return TeuthologyOpenStack(ctx, teuth_config, argv).main() File "/root/teuthology/teuthology/openstack.py", line 181, in main self.verify_openstack() File "/root/teuthology/teuthology/openstack.py", line 270, in verify_openstack str(providers)) Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is not a known OpenStack provider (('cloud.ovh.net', 'ovh'), ('control.os1.phx2', 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") Thank you. Regards, M Bharath Krishna On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >[moving to ceph-devel] > >Hi, > >On 27/09/2015 21:20, Bharath Krishna wrote: >> Hi, >> >> We have an openstack deployment in place with CEPH as CINDER backend. >> >> We would like to perform functional testing for CEPH and found >>teuthology as recommended option. >> >> Have successfully installed teuthology. Now to integrate it with >>Openstack, I could see that the possible providers could be either OVH, >>REDHAT or ENTERCLOUDSITE. >> >> Is there any option where in we can source openstack deployment of our >>own and test CEPH using teuthology? > >The documentation mentions these providers because they have been tested. >But there should be no blocker to run teuthology against a regular >OpenStack provider. Should you run into troubles, please let me know and >I'll help. > >Cheers > >> >> If NO, please suggest on how to test CEPH in such scenarios? >> >> Please help. >> >> Thank you. >> Bharath Krishna >> _______________________________________________ >> ceph-users mailing list >> ceph-users@lists.ceph.com >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >> > >-- >Loïc Dachary, Artisan Logiciel Libre > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-28 5:24 ` Bharath Krishna @ 2015-09-28 9:50 ` Loic Dachary 2015-09-30 5:51 ` Bharath Krishna 0 siblings, 1 reply; 10+ messages in thread From: Loic Dachary @ 2015-09-28 9:50 UTC (permalink / raw) To: Bharath Krishna, Ceph Development [-- Attachment #1: Type: text/plain, Size: 3399 bytes --] Hi, On 28/09/2015 07:24, Bharath Krishna wrote: > Hi Dachary, > > Thanks for the reply. I am following your blog http://dachary.org/?p=3767 > And the README in > https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#openstack > -backend The up to date instructions are at https://github.com/dachary/teuthology/tree/openstack/#openstack-backend (the link you used comes from http://dachary.org/?p=3828 and I just updated it so noone else will be confused). > > I have sourced the openrc file of my Openstack deployment and verified > that clients are working fine. My Openstack deployment has Cinder > integrated with CEPH backend. > > I have cloned and installed teuthology using the below steps: > > $ git clone -b wip-6502-openstack-v2 http://github.com/dachary/teuthology > $ cd teuthology ; ./bootstrap install > $ source virtualenv/bin/activate > > > Then I tried to run a dummy suite as test and I ran into following error: > > Traceback (most recent call last): > File "/root/teuthology/virtualenv/bin/teuthology-openstack", line 9, in > <module> > load_entry_point('teuthology==0.1.0', 'console_scripts', > 'teuthology-openstack')() > File "/root/teuthology/scripts/openstack.py", line 8, in main > teuthology.openstack.main(parse_args(argv), argv) > File "/root/teuthology/teuthology/openstack.py", line 375, in main > return TeuthologyOpenStack(ctx, teuth_config, argv).main() > File "/root/teuthology/teuthology/openstack.py", line 181, in main > self.verify_openstack() > File "/root/teuthology/teuthology/openstack.py", line 270, in > verify_openstack > str(providers)) > Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is not a > known OpenStack provider (('cloud.ovh.net', 'ovh'), ('control.os1.phx2', > 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") This limitation was in an earlier implementations and should not be a problem now. Cheers > > > Thank you. > > Regards, > M Bharath Krishna > > On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: > >> [moving to ceph-devel] >> >> Hi, >> >> On 27/09/2015 21:20, Bharath Krishna wrote: >>> Hi, >>> >>> We have an openstack deployment in place with CEPH as CINDER backend. >>> >>> We would like to perform functional testing for CEPH and found >>> teuthology as recommended option. >>> >>> Have successfully installed teuthology. Now to integrate it with >>> Openstack, I could see that the possible providers could be either OVH, >>> REDHAT or ENTERCLOUDSITE. >>> >>> Is there any option where in we can source openstack deployment of our >>> own and test CEPH using teuthology? >> >> The documentation mentions these providers because they have been tested. >> But there should be no blocker to run teuthology against a regular >> OpenStack provider. Should you run into troubles, please let me know and >> I'll help. >> >> Cheers >> >>> >>> If NO, please suggest on how to test CEPH in such scenarios? >>> >>> Please help. >>> >>> Thank you. >>> Bharath Krishna >>> _______________________________________________ >>> ceph-users mailing list >>> ceph-users@lists.ceph.com >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>> >> >> -- >> Loïc Dachary, Artisan Logiciel Libre >> > -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 198 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-28 9:50 ` Loic Dachary @ 2015-09-30 5:51 ` Bharath Krishna 2015-09-30 8:50 ` Loic Dachary 0 siblings, 1 reply; 10+ messages in thread From: Bharath Krishna @ 2015-09-30 5:51 UTC (permalink / raw) To: Loic Dachary, Ceph Development Hi, Thanks a lot for pointing to right git and instructions. I have passed that step now and teuthology VM got created. But teuthology openstack command fails to parse the instance id from the json format output of below command: DEBUG:teuthology.misc:openstack server show -f json teuthology output "OS-EXT-STS:task_state": null, "addresses": ³Primary_External_Net=<ip-address>", "image": "teuthology-ubuntu-14.04 (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)", "OS-EXT-STS:vm_state": "active", "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8", "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000", "flavor": "m1.small (2)", "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48", "security_groups": [ { "name": "teuthology" } ], "user_id": "281f9aa2d9c54177b45e72db742b4744", "OS-DCF:diskConfig": "MANUAL", "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "OS-EXT-AZ:availability_zone": "az3", "config_drive": "", "status": "ACTIVE", "updated": "2015-09-28T10:33:09Z", "hostId": "b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3", "OS-EXT-SRV-ATTR:host": ³hostname", "OS-SRV-USG:terminated_at": null, "key_name": "ceph_test_key", "properties": "", "project_id": "1d0137fe585742bdbe13e2b16daab6ff", "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname", "name": "teuthology", "created": "2015-09-28T10:32:47Z", "os-extended-volumes:volumes_attached": [] } Traceback (most recent call last): File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, in <module> load_entry_point('teuthology==0.1.0', 'console_scripts', 'teuthology-openstack')() File "/opt/teuthology/scripts/openstack.py", line 8, in main teuthology.openstack.main(parse_args(argv), argv) File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, in main return TeuthologyOpenStack(ctx, teuth_config, argv).main() File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, in main ip = self.setup() File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, in setup if not self.cluster_exists(): File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, in cluster_exists instance_id = self.get_instance_id(self.args.name) File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, in get_instance_id return TeuthologyOpenStack.get_value(instance, 'id') File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in get_value return filter(lambda v: v['Field'] == field, result)[0]['Value'] File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in <lambda> return filter(lambda v: v['Field'] == field, result)[0]['Value'] TypeError: string indices must be integers I could understand that we are trying to get instance id value using get_value method, but it fails with an exception even though instance id shown is a valid format of id. Any pointers to fix this will greatly help. Thank you. Regards, M Bharath Krishna On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >Hi, > >On 28/09/2015 07:24, Bharath Krishna wrote: >> Hi Dachary, >> >> Thanks for the reply. I am following your blog >>http://dachary.org/?p=3767 >> And the README in >> >>https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#opensta >>ck >> -backend > >The up to date instructions are at >https://github.com/dachary/teuthology/tree/openstack/#openstack-backend >(the link you used comes from http://dachary.org/?p=3828 and I just >updated it so noone else will be confused). >> >> I have sourced the openrc file of my Openstack deployment and verified >> that clients are working fine. My Openstack deployment has Cinder >> integrated with CEPH backend. >> >> I have cloned and installed teuthology using the below steps: >> >> $ git clone -b wip-6502-openstack-v2 >>http://github.com/dachary/teuthology >> $ cd teuthology ; ./bootstrap install >> $ source virtualenv/bin/activate >> >> >> Then I tried to run a dummy suite as test and I ran into following >>error: >> >> Traceback (most recent call last): >> File "/root/teuthology/virtualenv/bin/teuthology-openstack", line 9, >>in >> <module> >> load_entry_point('teuthology==0.1.0', 'console_scripts', >> 'teuthology-openstack')() >> File "/root/teuthology/scripts/openstack.py", line 8, in main >> teuthology.openstack.main(parse_args(argv), argv) >> File "/root/teuthology/teuthology/openstack.py", line 375, in main >> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >> File "/root/teuthology/teuthology/openstack.py", line 181, in main >> self.verify_openstack() >> File "/root/teuthology/teuthology/openstack.py", line 270, in >> verify_openstack >> str(providers)) >> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is not a >> known OpenStack provider (('cloud.ovh.net', 'ovh'), ('control.os1.phx2', >> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") > >This limitation was in an earlier implementations and should not be a >problem now. > >Cheers > >> >> >> Thank you. >> >> Regards, >> M Bharath Krishna >> >> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >> >>> [moving to ceph-devel] >>> >>> Hi, >>> >>> On 27/09/2015 21:20, Bharath Krishna wrote: >>>> Hi, >>>> >>>> We have an openstack deployment in place with CEPH as CINDER backend. >>>> >>>> We would like to perform functional testing for CEPH and found >>>> teuthology as recommended option. >>>> >>>> Have successfully installed teuthology. Now to integrate it with >>>> Openstack, I could see that the possible providers could be either >>>>OVH, >>>> REDHAT or ENTERCLOUDSITE. >>>> >>>> Is there any option where in we can source openstack deployment of our >>>> own and test CEPH using teuthology? >>> >>> The documentation mentions these providers because they have been >>>tested. >>> But there should be no blocker to run teuthology against a regular >>> OpenStack provider. Should you run into troubles, please let me know >>>and >>> I'll help. >>> >>> Cheers >>> >>>> >>>> If NO, please suggest on how to test CEPH in such scenarios? >>>> >>>> Please help. >>>> >>>> Thank you. >>>> Bharath Krishna >>>> _______________________________________________ >>>> ceph-users mailing list >>>> ceph-users@lists.ceph.com >>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>> >>> >>> -- >>> Loïc Dachary, Artisan Logiciel Libre >>> >> > >-- >Loïc Dachary, Artisan Logiciel Libre > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-30 5:51 ` Bharath Krishna @ 2015-09-30 8:50 ` Loic Dachary 2015-09-30 9:34 ` Bharath Krishna 0 siblings, 1 reply; 10+ messages in thread From: Loic Dachary @ 2015-09-30 8:50 UTC (permalink / raw) To: Bharath Krishna, Ceph Development [-- Attachment #1: Type: text/plain, Size: 9437 bytes --] Hi, On 30/09/2015 07:51, Bharath Krishna wrote: > Hi, > > Thanks a lot for pointing to right git and instructions. I have passed > that step now and teuthology VM got created. > > But teuthology openstack command fails to parse the instance id from the > json format output of below command: > > DEBUG:teuthology.misc:openstack server show -f json teuthology output > > "OS-EXT-STS:task_state": null, > "addresses": ³Primary_External_Net=<ip-address>", > "image": "teuthology-ubuntu-14.04 > (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)", > "OS-EXT-STS:vm_state": "active", > "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8", > "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000", > "flavor": "m1.small (2)", > "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48", > "security_groups": [ > { > "name": "teuthology" > } > ], > "user_id": "281f9aa2d9c54177b45e72db742b4744", > "OS-DCF:diskConfig": "MANUAL", > "accessIPv4": "", > "accessIPv6": "", > "progress": 0, > "OS-EXT-STS:power_state": 1, > "OS-EXT-AZ:availability_zone": "az3", > "config_drive": "", > "status": "ACTIVE", > "updated": "2015-09-28T10:33:09Z", > "hostId": "b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3", > "OS-EXT-SRV-ATTR:host": ³hostname", > "OS-SRV-USG:terminated_at": null, > "key_name": "ceph_test_key", > "properties": "", > "project_id": "1d0137fe585742bdbe13e2b16daab6ff", > "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname", > "name": "teuthology", > "created": "2015-09-28T10:32:47Z", > "os-extended-volumes:volumes_attached": [] > } > Traceback (most recent call last): > File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, in > <module> > load_entry_point('teuthology==0.1.0', 'console_scripts', > 'teuthology-openstack')() > File "/opt/teuthology/scripts/openstack.py", line 8, in main > teuthology.openstack.main(parse_args(argv), argv) > File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, in > main > return TeuthologyOpenStack(ctx, teuth_config, argv).main() > File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, in > main > ip = self.setup() > File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, in > setup > if not self.cluster_exists(): > File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, in > cluster_exists > instance_id = self.get_instance_id(self.args.name) > File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, in > get_instance_id > return TeuthologyOpenStack.get_value(instance, 'id') > File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in > get_value > return filter(lambda v: v['Field'] == field, result)[0]['Value'] > File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in > <lambda> > return filter(lambda v: v['Field'] == field, result)[0]['Value'] > TypeError: string indices must be integers > > > I could understand that we are trying to get instance id value using > get_value method, but it fails with an exception even though instance id > shown is a valid format of id. > > Any pointers to fix this will greatly help. It appears that the format of the json output is very different on your implementation. Here is the kind of output I get on all the clusters I tried. Which OpenStack version is your cluster running ? $ openstack server show -f json target225193 | jq . [ { "Value": "MANUAL", "Field": "OS-DCF:diskConfig" }, { "Value": "nova", "Field": "OS-EXT-AZ:availability_zone" }, { "Value": 1, "Field": "OS-EXT-STS:power_state" }, { "Value": null, "Field": "OS-EXT-STS:task_state" }, { "Value": "active", "Field": "OS-EXT-STS:vm_state" }, { "Value": "2015-09-30T08:37:55.000000", "Field": "OS-SRV-USG:launched_at" }, { "Value": null, "Field": "OS-SRV-USG:terminated_at" }, { "Value": "", "Field": "accessIPv4" }, { "Value": "", "Field": "accessIPv6" }, { "Value": "Ext-Net=167.114.225.193", "Field": "addresses" }, { "Value": "", "Field": "config_drive" }, { "Value": "2015-09-30T08:37:01Z", "Field": "created" }, { "Value": "vps-ssd-3 (e43d7458-6b82-4a78-a712-3a4dc6748cf4)", "Field": "flavor" }, { "Value": "38119f63edc62252c491fa7e9a8d164a90c48db09fdee1a5687c1c7f", "Field": "hostId" }, { "Value": "897cbcc9-d662-4ae9-bb68-a71ef4269cdc", "Field": "id" }, { "Value": "teuthology-centos-7.0 (67438ecf-803c-45a6-83bb-54a0ba0d0b6c)", "Field": "image" }, { "Value": "teuthology", "Field": "key_name" }, { "Value": "target225193", "Field": "name" }, { "Value": [], "Field": "os-extended-volumes:volumes_attached" }, { "Value": 0, "Field": "progress" }, { "Value": "131b886b156a4f84b5f41baf2fbe646c", "Field": "project_id" }, { "Value": "ownedby='167.114.249.14', teuthology='d48f8bc9adf785614308e33094933a72'", "Field": "properties" }, { "Value": [ { "name": "teuthology" } ], "Field": "security_groups" }, { "Value": "ACTIVE", "Field": "status" }, { "Value": "2015-09-30T08:39:08Z", "Field": "updated" }, { "Value": "291dde1633154837be2693c6ffa6315c", "Field": "user_id" } ] > > Thank you. > > Regards, > M Bharath Krishna > > > On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote: > >> Hi, >> >> On 28/09/2015 07:24, Bharath Krishna wrote: >>> Hi Dachary, >>> >>> Thanks for the reply. I am following your blog >>> http://dachary.org/?p=3767 >>> And the README in >>> >>> https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#opensta >>> ck >>> -backend >> >> The up to date instructions are at >> https://github.com/dachary/teuthology/tree/openstack/#openstack-backend >> (the link you used comes from http://dachary.org/?p=3828 and I just >> updated it so noone else will be confused). >>> >>> I have sourced the openrc file of my Openstack deployment and verified >>> that clients are working fine. My Openstack deployment has Cinder >>> integrated with CEPH backend. >>> >>> I have cloned and installed teuthology using the below steps: >>> >>> $ git clone -b wip-6502-openstack-v2 >>> http://github.com/dachary/teuthology >>> $ cd teuthology ; ./bootstrap install >>> $ source virtualenv/bin/activate >>> >>> >>> Then I tried to run a dummy suite as test and I ran into following >>> error: >>> >>> Traceback (most recent call last): >>> File "/root/teuthology/virtualenv/bin/teuthology-openstack", line 9, >>> in >>> <module> >>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>> 'teuthology-openstack')() >>> File "/root/teuthology/scripts/openstack.py", line 8, in main >>> teuthology.openstack.main(parse_args(argv), argv) >>> File "/root/teuthology/teuthology/openstack.py", line 375, in main >>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>> File "/root/teuthology/teuthology/openstack.py", line 181, in main >>> self.verify_openstack() >>> File "/root/teuthology/teuthology/openstack.py", line 270, in >>> verify_openstack >>> str(providers)) >>> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is not a >>> known OpenStack provider (('cloud.ovh.net', 'ovh'), ('control.os1.phx2', >>> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") >> >> This limitation was in an earlier implementations and should not be a >> problem now. >> >> Cheers >> >>> >>> >>> Thank you. >>> >>> Regards, >>> M Bharath Krishna >>> >>> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >>> >>>> [moving to ceph-devel] >>>> >>>> Hi, >>>> >>>> On 27/09/2015 21:20, Bharath Krishna wrote: >>>>> Hi, >>>>> >>>>> We have an openstack deployment in place with CEPH as CINDER backend. >>>>> >>>>> We would like to perform functional testing for CEPH and found >>>>> teuthology as recommended option. >>>>> >>>>> Have successfully installed teuthology. Now to integrate it with >>>>> Openstack, I could see that the possible providers could be either >>>>> OVH, >>>>> REDHAT or ENTERCLOUDSITE. >>>>> >>>>> Is there any option where in we can source openstack deployment of our >>>>> own and test CEPH using teuthology? >>>> >>>> The documentation mentions these providers because they have been >>>> tested. >>>> But there should be no blocker to run teuthology against a regular >>>> OpenStack provider. Should you run into troubles, please let me know >>>> and >>>> I'll help. >>>> >>>> Cheers >>>> >>>>> >>>>> If NO, please suggest on how to test CEPH in such scenarios? >>>>> >>>>> Please help. >>>>> >>>>> Thank you. >>>>> Bharath Krishna >>>>> _______________________________________________ >>>>> ceph-users mailing list >>>>> ceph-users@lists.ceph.com >>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>> >>>> >>>> -- >>>> Loïc Dachary, Artisan Logiciel Libre >>>> >>> >> >> -- >> Loïc Dachary, Artisan Logiciel Libre >> > -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 198 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-30 8:50 ` Loic Dachary @ 2015-09-30 9:34 ` Bharath Krishna 2015-09-30 10:12 ` Loic Dachary 0 siblings, 1 reply; 10+ messages in thread From: Bharath Krishna @ 2015-09-30 9:34 UTC (permalink / raw) To: Loic Dachary, Ceph Development Hi Loic, Does piping the command output of "openstack server show -f json <target-name>” to jq alter the output format? Openstack version being used is Juno. Thank you Regards, M Bharath Krishna On 9/30/15, 2:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >Hi, > >On 30/09/2015 07:51, Bharath Krishna wrote: >> Hi, >> >> Thanks a lot for pointing to right git and instructions. I have passed >> that step now and teuthology VM got created. >> >> But teuthology openstack command fails to parse the instance id from the >> json format output of below command: >> >> DEBUG:teuthology.misc:openstack server show -f json teuthology output >> >> "OS-EXT-STS:task_state": null, >> "addresses": ³Primary_External_Net=<ip-address>", >> "image": "teuthology-ubuntu-14.04 >> (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)", >> "OS-EXT-STS:vm_state": "active", >> "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8", >> "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000", >> "flavor": "m1.small (2)", >> "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48", >> "security_groups": [ >> { >> "name": "teuthology" >> } >> ], >> "user_id": "281f9aa2d9c54177b45e72db742b4744", >> "OS-DCF:diskConfig": "MANUAL", >> "accessIPv4": "", >> "accessIPv6": "", >> "progress": 0, >> "OS-EXT-STS:power_state": 1, >> "OS-EXT-AZ:availability_zone": "az3", >> "config_drive": "", >> "status": "ACTIVE", >> "updated": "2015-09-28T10:33:09Z", >> "hostId": "b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3", >> "OS-EXT-SRV-ATTR:host": ³hostname", >> "OS-SRV-USG:terminated_at": null, >> "key_name": "ceph_test_key", >> "properties": "", >> "project_id": "1d0137fe585742bdbe13e2b16daab6ff", >> "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname", >> "name": "teuthology", >> "created": "2015-09-28T10:32:47Z", >> "os-extended-volumes:volumes_attached": [] >> } >> Traceback (most recent call last): >> File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, in >> <module> >> load_entry_point('teuthology==0.1.0', 'console_scripts', >> 'teuthology-openstack')() >> File "/opt/teuthology/scripts/openstack.py", line 8, in main >> teuthology.openstack.main(parse_args(argv), argv) >> File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, in >> main >> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >> File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, in >> main >> ip = self.setup() >> File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, in >> setup >> if not self.cluster_exists(): >> File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, in >> cluster_exists >> instance_id = self.get_instance_id(self.args.name) >> File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, in >> get_instance_id >> return TeuthologyOpenStack.get_value(instance, 'id') >> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >> get_value >> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >> <lambda> >> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >> TypeError: string indices must be integers >> >> >> I could understand that we are trying to get instance id value using >> get_value method, but it fails with an exception even though instance id >> shown is a valid format of id. >> >> Any pointers to fix this will greatly help. > >It appears that the format of the json output is very different on your >implementation. Here is the kind of output I get on all the clusters I >tried. Which OpenStack version is your cluster running ? > >$ openstack server show -f json target225193 | jq . >[ > { > "Value": "MANUAL", > "Field": "OS-DCF:diskConfig" > }, > { > "Value": "nova", > "Field": "OS-EXT-AZ:availability_zone" > }, > { > "Value": 1, > "Field": "OS-EXT-STS:power_state" > }, > { > "Value": null, > "Field": "OS-EXT-STS:task_state" > }, > { > "Value": "active", > "Field": "OS-EXT-STS:vm_state" > }, > { > "Value": "2015-09-30T08:37:55.000000", > "Field": "OS-SRV-USG:launched_at" > }, > { > "Value": null, > "Field": "OS-SRV-USG:terminated_at" > }, > { > "Value": "", > "Field": "accessIPv4" > }, > { > "Value": "", > "Field": "accessIPv6" > }, > { > "Value": "Ext-Net=167.114.225.193", > "Field": "addresses" > }, > { > "Value": "", > "Field": "config_drive" > }, > { > "Value": "2015-09-30T08:37:01Z", > "Field": "created" > }, > { > "Value": "vps-ssd-3 (e43d7458-6b82-4a78-a712-3a4dc6748cf4)", > "Field": "flavor" > }, > { > "Value": "38119f63edc62252c491fa7e9a8d164a90c48db09fdee1a5687c1c7f", > "Field": "hostId" > }, > { > "Value": "897cbcc9-d662-4ae9-bb68-a71ef4269cdc", > "Field": "id" > }, > { > "Value": "teuthology-centos-7.0 >(67438ecf-803c-45a6-83bb-54a0ba0d0b6c)", > "Field": "image" > }, > { > "Value": "teuthology", > "Field": "key_name" > }, > { > "Value": "target225193", > "Field": "name" > }, > { > "Value": [], > "Field": "os-extended-volumes:volumes_attached" > }, > { > "Value": 0, > "Field": "progress" > }, > { > "Value": "131b886b156a4f84b5f41baf2fbe646c", > "Field": "project_id" > }, > { > "Value": "ownedby='167.114.249.14', >teuthology='d48f8bc9adf785614308e33094933a72'", > "Field": "properties" > }, > { > "Value": [ > { > "name": "teuthology" > } > ], > "Field": "security_groups" > }, > { > "Value": "ACTIVE", > "Field": "status" > }, > { > "Value": "2015-09-30T08:39:08Z", > "Field": "updated" > }, > { > "Value": "291dde1633154837be2693c6ffa6315c", > "Field": "user_id" > } >] > >> >> Thank you. >> >> Regards, >> M Bharath Krishna >> >> >> On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >> >>> Hi, >>> >>> On 28/09/2015 07:24, Bharath Krishna wrote: >>>> Hi Dachary, >>>> >>>> Thanks for the reply. I am following your blog >>>> http://dachary.org/?p=3767 >>>> And the README in >>>> >>>> >>>>https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#opens >>>>ta >>>> ck >>>> -backend >>> >>> The up to date instructions are at >>> https://github.com/dachary/teuthology/tree/openstack/#openstack-backend >>> (the link you used comes from http://dachary.org/?p=3828 and I just >>> updated it so noone else will be confused). >>>> >>>> I have sourced the openrc file of my Openstack deployment and verified >>>> that clients are working fine. My Openstack deployment has Cinder >>>> integrated with CEPH backend. >>>> >>>> I have cloned and installed teuthology using the below steps: >>>> >>>> $ git clone -b wip-6502-openstack-v2 >>>> http://github.com/dachary/teuthology >>>> $ cd teuthology ; ./bootstrap install >>>> $ source virtualenv/bin/activate >>>> >>>> >>>> Then I tried to run a dummy suite as test and I ran into following >>>> error: >>>> >>>> Traceback (most recent call last): >>>> File "/root/teuthology/virtualenv/bin/teuthology-openstack", line 9, >>>> in >>>> <module> >>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>> 'teuthology-openstack')() >>>> File "/root/teuthology/scripts/openstack.py", line 8, in main >>>> teuthology.openstack.main(parse_args(argv), argv) >>>> File "/root/teuthology/teuthology/openstack.py", line 375, in main >>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>> File "/root/teuthology/teuthology/openstack.py", line 181, in main >>>> self.verify_openstack() >>>> File "/root/teuthology/teuthology/openstack.py", line 270, in >>>> verify_openstack >>>> str(providers)) >>>> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is >>>>not a >>>> known OpenStack provider (('cloud.ovh.net', 'ovh'), >>>>('control.os1.phx2', >>>> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") >>> >>> This limitation was in an earlier implementations and should not be a >>> problem now. >>> >>> Cheers >>> >>>> >>>> >>>> Thank you. >>>> >>>> Regards, >>>> M Bharath Krishna >>>> >>>> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >>>> >>>>> [moving to ceph-devel] >>>>> >>>>> Hi, >>>>> >>>>> On 27/09/2015 21:20, Bharath Krishna wrote: >>>>>> Hi, >>>>>> >>>>>> We have an openstack deployment in place with CEPH as CINDER >>>>>>backend. >>>>>> >>>>>> We would like to perform functional testing for CEPH and found >>>>>> teuthology as recommended option. >>>>>> >>>>>> Have successfully installed teuthology. Now to integrate it with >>>>>> Openstack, I could see that the possible providers could be either >>>>>> OVH, >>>>>> REDHAT or ENTERCLOUDSITE. >>>>>> >>>>>> Is there any option where in we can source openstack deployment of >>>>>>our >>>>>> own and test CEPH using teuthology? >>>>> >>>>> The documentation mentions these providers because they have been >>>>> tested. >>>>> But there should be no blocker to run teuthology against a regular >>>>> OpenStack provider. Should you run into troubles, please let me know >>>>> and >>>>> I'll help. >>>>> >>>>> Cheers >>>>> >>>>>> >>>>>> If NO, please suggest on how to test CEPH in such scenarios? >>>>>> >>>>>> Please help. >>>>>> >>>>>> Thank you. >>>>>> Bharath Krishna >>>>>> _______________________________________________ >>>>>> ceph-users mailing list >>>>>> ceph-users@lists.ceph.com >>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>> >>>>> >>>>> -- >>>>> Loïc Dachary, Artisan Logiciel Libre >>>>> >>>> >>> >>> -- >>> Loïc Dachary, Artisan Logiciel Libre >>> >> > >-- >Loïc Dachary, Artisan Logiciel Libre > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-30 9:34 ` Bharath Krishna @ 2015-09-30 10:12 ` Loic Dachary 2015-09-30 10:17 ` Bharath Krishna 0 siblings, 1 reply; 10+ messages in thread From: Loic Dachary @ 2015-09-30 10:12 UTC (permalink / raw) To: Bharath Krishna, Ceph Development [-- Attachment #1: Type: text/plain, Size: 10777 bytes --] On 30/09/2015 11:34, Bharath Krishna wrote: > Hi Loic, > > Does piping the command output of "openstack server show -f json > <target-name>” to jq alter the output format? It just displays it nicely but does not otherwise change it. > > Openstack version being used is Juno. That's also the version of some of the clusters I use. What version of the openstack cli do you have ? $ openstack --version openstack 1.7.0 > > Thank you > > Regards, > M Bharath Krishna > > On 9/30/15, 2:20 PM, "Loic Dachary" <loic@dachary.org> wrote: > >> Hi, >> >> On 30/09/2015 07:51, Bharath Krishna wrote: >>> Hi, >>> >>> Thanks a lot for pointing to right git and instructions. I have passed >>> that step now and teuthology VM got created. >>> >>> But teuthology openstack command fails to parse the instance id from the >>> json format output of below command: >>> >>> DEBUG:teuthology.misc:openstack server show -f json teuthology output >>> >>> "OS-EXT-STS:task_state": null, >>> "addresses": ³Primary_External_Net=<ip-address>", >>> "image": "teuthology-ubuntu-14.04 >>> (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)", >>> "OS-EXT-STS:vm_state": "active", >>> "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8", >>> "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000", >>> "flavor": "m1.small (2)", >>> "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48", >>> "security_groups": [ >>> { >>> "name": "teuthology" >>> } >>> ], >>> "user_id": "281f9aa2d9c54177b45e72db742b4744", >>> "OS-DCF:diskConfig": "MANUAL", >>> "accessIPv4": "", >>> "accessIPv6": "", >>> "progress": 0, >>> "OS-EXT-STS:power_state": 1, >>> "OS-EXT-AZ:availability_zone": "az3", >>> "config_drive": "", >>> "status": "ACTIVE", >>> "updated": "2015-09-28T10:33:09Z", >>> "hostId": "b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3", >>> "OS-EXT-SRV-ATTR:host": ³hostname", >>> "OS-SRV-USG:terminated_at": null, >>> "key_name": "ceph_test_key", >>> "properties": "", >>> "project_id": "1d0137fe585742bdbe13e2b16daab6ff", >>> "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname", >>> "name": "teuthology", >>> "created": "2015-09-28T10:32:47Z", >>> "os-extended-volumes:volumes_attached": [] >>> } >>> Traceback (most recent call last): >>> File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, in >>> <module> >>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>> 'teuthology-openstack')() >>> File "/opt/teuthology/scripts/openstack.py", line 8, in main >>> teuthology.openstack.main(parse_args(argv), argv) >>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, in >>> main >>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, in >>> main >>> ip = self.setup() >>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, in >>> setup >>> if not self.cluster_exists(): >>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, in >>> cluster_exists >>> instance_id = self.get_instance_id(self.args.name) >>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, in >>> get_instance_id >>> return TeuthologyOpenStack.get_value(instance, 'id') >>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>> get_value >>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>> <lambda> >>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>> TypeError: string indices must be integers >>> >>> >>> I could understand that we are trying to get instance id value using >>> get_value method, but it fails with an exception even though instance id >>> shown is a valid format of id. >>> >>> Any pointers to fix this will greatly help. >> >> It appears that the format of the json output is very different on your >> implementation. Here is the kind of output I get on all the clusters I >> tried. Which OpenStack version is your cluster running ? >> >> $ openstack server show -f json target225193 | jq . >> [ >> { >> "Value": "MANUAL", >> "Field": "OS-DCF:diskConfig" >> }, >> { >> "Value": "nova", >> "Field": "OS-EXT-AZ:availability_zone" >> }, >> { >> "Value": 1, >> "Field": "OS-EXT-STS:power_state" >> }, >> { >> "Value": null, >> "Field": "OS-EXT-STS:task_state" >> }, >> { >> "Value": "active", >> "Field": "OS-EXT-STS:vm_state" >> }, >> { >> "Value": "2015-09-30T08:37:55.000000", >> "Field": "OS-SRV-USG:launched_at" >> }, >> { >> "Value": null, >> "Field": "OS-SRV-USG:terminated_at" >> }, >> { >> "Value": "", >> "Field": "accessIPv4" >> }, >> { >> "Value": "", >> "Field": "accessIPv6" >> }, >> { >> "Value": "Ext-Net=167.114.225.193", >> "Field": "addresses" >> }, >> { >> "Value": "", >> "Field": "config_drive" >> }, >> { >> "Value": "2015-09-30T08:37:01Z", >> "Field": "created" >> }, >> { >> "Value": "vps-ssd-3 (e43d7458-6b82-4a78-a712-3a4dc6748cf4)", >> "Field": "flavor" >> }, >> { >> "Value": "38119f63edc62252c491fa7e9a8d164a90c48db09fdee1a5687c1c7f", >> "Field": "hostId" >> }, >> { >> "Value": "897cbcc9-d662-4ae9-bb68-a71ef4269cdc", >> "Field": "id" >> }, >> { >> "Value": "teuthology-centos-7.0 >> (67438ecf-803c-45a6-83bb-54a0ba0d0b6c)", >> "Field": "image" >> }, >> { >> "Value": "teuthology", >> "Field": "key_name" >> }, >> { >> "Value": "target225193", >> "Field": "name" >> }, >> { >> "Value": [], >> "Field": "os-extended-volumes:volumes_attached" >> }, >> { >> "Value": 0, >> "Field": "progress" >> }, >> { >> "Value": "131b886b156a4f84b5f41baf2fbe646c", >> "Field": "project_id" >> }, >> { >> "Value": "ownedby='167.114.249.14', >> teuthology='d48f8bc9adf785614308e33094933a72'", >> "Field": "properties" >> }, >> { >> "Value": [ >> { >> "name": "teuthology" >> } >> ], >> "Field": "security_groups" >> }, >> { >> "Value": "ACTIVE", >> "Field": "status" >> }, >> { >> "Value": "2015-09-30T08:39:08Z", >> "Field": "updated" >> }, >> { >> "Value": "291dde1633154837be2693c6ffa6315c", >> "Field": "user_id" >> } >> ] >> >>> >>> Thank you. >>> >>> Regards, >>> M Bharath Krishna >>> >>> >>> On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >>> >>>> Hi, >>>> >>>> On 28/09/2015 07:24, Bharath Krishna wrote: >>>>> Hi Dachary, >>>>> >>>>> Thanks for the reply. I am following your blog >>>>> http://dachary.org/?p=3767 >>>>> And the README in >>>>> >>>>> >>>>> https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#opens >>>>> ta >>>>> ck >>>>> -backend >>>> >>>> The up to date instructions are at >>>> https://github.com/dachary/teuthology/tree/openstack/#openstack-backend >>>> (the link you used comes from http://dachary.org/?p=3828 and I just >>>> updated it so noone else will be confused). >>>>> >>>>> I have sourced the openrc file of my Openstack deployment and verified >>>>> that clients are working fine. My Openstack deployment has Cinder >>>>> integrated with CEPH backend. >>>>> >>>>> I have cloned and installed teuthology using the below steps: >>>>> >>>>> $ git clone -b wip-6502-openstack-v2 >>>>> http://github.com/dachary/teuthology >>>>> $ cd teuthology ; ./bootstrap install >>>>> $ source virtualenv/bin/activate >>>>> >>>>> >>>>> Then I tried to run a dummy suite as test and I ran into following >>>>> error: >>>>> >>>>> Traceback (most recent call last): >>>>> File "/root/teuthology/virtualenv/bin/teuthology-openstack", line 9, >>>>> in >>>>> <module> >>>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>>> 'teuthology-openstack')() >>>>> File "/root/teuthology/scripts/openstack.py", line 8, in main >>>>> teuthology.openstack.main(parse_args(argv), argv) >>>>> File "/root/teuthology/teuthology/openstack.py", line 375, in main >>>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>>> File "/root/teuthology/teuthology/openstack.py", line 181, in main >>>>> self.verify_openstack() >>>>> File "/root/teuthology/teuthology/openstack.py", line 270, in >>>>> verify_openstack >>>>> str(providers)) >>>>> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is >>>>> not a >>>>> known OpenStack provider (('cloud.ovh.net', 'ovh'), >>>>> ('control.os1.phx2', >>>>> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") >>>> >>>> This limitation was in an earlier implementations and should not be a >>>> problem now. >>>> >>>> Cheers >>>> >>>>> >>>>> >>>>> Thank you. >>>>> >>>>> Regards, >>>>> M Bharath Krishna >>>>> >>>>> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >>>>> >>>>>> [moving to ceph-devel] >>>>>> >>>>>> Hi, >>>>>> >>>>>> On 27/09/2015 21:20, Bharath Krishna wrote: >>>>>>> Hi, >>>>>>> >>>>>>> We have an openstack deployment in place with CEPH as CINDER >>>>>>> backend. >>>>>>> >>>>>>> We would like to perform functional testing for CEPH and found >>>>>>> teuthology as recommended option. >>>>>>> >>>>>>> Have successfully installed teuthology. Now to integrate it with >>>>>>> Openstack, I could see that the possible providers could be either >>>>>>> OVH, >>>>>>> REDHAT or ENTERCLOUDSITE. >>>>>>> >>>>>>> Is there any option where in we can source openstack deployment of >>>>>>> our >>>>>>> own and test CEPH using teuthology? >>>>>> >>>>>> The documentation mentions these providers because they have been >>>>>> tested. >>>>>> But there should be no blocker to run teuthology against a regular >>>>>> OpenStack provider. Should you run into troubles, please let me know >>>>>> and >>>>>> I'll help. >>>>>> >>>>>> Cheers >>>>>> >>>>>>> >>>>>>> If NO, please suggest on how to test CEPH in such scenarios? >>>>>>> >>>>>>> Please help. >>>>>>> >>>>>>> Thank you. >>>>>>> Bharath Krishna >>>>>>> _______________________________________________ >>>>>>> ceph-users mailing list >>>>>>> ceph-users@lists.ceph.com >>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>>> >>>>>> >>>>>> -- >>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>> >>>>> >>>> >>>> -- >>>> Loïc Dachary, Artisan Logiciel Libre >>>> >>> >> >> -- >> Loïc Dachary, Artisan Logiciel Libre >> > -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 198 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-30 10:12 ` Loic Dachary @ 2015-09-30 10:17 ` Bharath Krishna 2015-09-30 10:35 ` Loic Dachary 0 siblings, 1 reply; 10+ messages in thread From: Bharath Krishna @ 2015-09-30 10:17 UTC (permalink / raw) To: Loic Dachary, Ceph Development Its the same version I do have as well. #openstack --version openstack 1.7.0 Thank you. Regards M Bharath Krishna On 9/30/15, 3:42 PM, "Loic Dachary" <loic@dachary.org> wrote: > > >On 30/09/2015 11:34, Bharath Krishna wrote: >> Hi Loic, >> >> Does piping the command output of "openstack server show -f json >> <target-name>” to jq alter the output format? > >It just displays it nicely but does not otherwise change it. > > >> >> Openstack version being used is Juno. > >That's also the version of some of the clusters I use. What version of >the openstack cli do you have ? > >$ openstack --version >openstack 1.7.0 > > >> >> Thank you >> >> Regards, >> M Bharath Krishna >> >> On 9/30/15, 2:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >> >>> Hi, >>> >>> On 30/09/2015 07:51, Bharath Krishna wrote: >>>> Hi, >>>> >>>> Thanks a lot for pointing to right git and instructions. I have passed >>>> that step now and teuthology VM got created. >>>> >>>> But teuthology openstack command fails to parse the instance id from >>>>the >>>> json format output of below command: >>>> >>>> DEBUG:teuthology.misc:openstack server show -f json teuthology output >>>> >>>> "OS-EXT-STS:task_state": null, >>>> "addresses": ³Primary_External_Net=<ip-address>", >>>> "image": "teuthology-ubuntu-14.04 >>>> (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)", >>>> "OS-EXT-STS:vm_state": "active", >>>> "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8", >>>> "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000", >>>> "flavor": "m1.small (2)", >>>> "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48", >>>> "security_groups": [ >>>> { >>>> "name": "teuthology" >>>> } >>>> ], >>>> "user_id": "281f9aa2d9c54177b45e72db742b4744", >>>> "OS-DCF:diskConfig": "MANUAL", >>>> "accessIPv4": "", >>>> "accessIPv6": "", >>>> "progress": 0, >>>> "OS-EXT-STS:power_state": 1, >>>> "OS-EXT-AZ:availability_zone": "az3", >>>> "config_drive": "", >>>> "status": "ACTIVE", >>>> "updated": "2015-09-28T10:33:09Z", >>>> "hostId": >>>>"b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3", >>>> "OS-EXT-SRV-ATTR:host": ³hostname", >>>> "OS-SRV-USG:terminated_at": null, >>>> "key_name": "ceph_test_key", >>>> "properties": "", >>>> "project_id": "1d0137fe585742bdbe13e2b16daab6ff", >>>> "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname", >>>> "name": "teuthology", >>>> "created": "2015-09-28T10:32:47Z", >>>> "os-extended-volumes:volumes_attached": [] >>>> } >>>> Traceback (most recent call last): >>>> File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, >>>>in >>>> <module> >>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>> 'teuthology-openstack')() >>>> File "/opt/teuthology/scripts/openstack.py", line 8, in main >>>> teuthology.openstack.main(parse_args(argv), argv) >>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, >>>>in >>>> main >>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, >>>>in >>>> main >>>> ip = self.setup() >>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, >>>>in >>>> setup >>>> if not self.cluster_exists(): >>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, >>>>in >>>> cluster_exists >>>> instance_id = self.get_instance_id(self.args.name) >>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, >>>>in >>>> get_instance_id >>>> return TeuthologyOpenStack.get_value(instance, 'id') >>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>>> get_value >>>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>>> <lambda> >>>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>>> TypeError: string indices must be integers >>>> >>>> >>>> I could understand that we are trying to get instance id value using >>>> get_value method, but it fails with an exception even though instance >>>>id >>>> shown is a valid format of id. >>>> >>>> Any pointers to fix this will greatly help. >>> >>> It appears that the format of the json output is very different on your >>> implementation. Here is the kind of output I get on all the clusters I >>> tried. Which OpenStack version is your cluster running ? >>> >>> $ openstack server show -f json target225193 | jq . >>> [ >>> { >>> "Value": "MANUAL", >>> "Field": "OS-DCF:diskConfig" >>> }, >>> { >>> "Value": "nova", >>> "Field": "OS-EXT-AZ:availability_zone" >>> }, >>> { >>> "Value": 1, >>> "Field": "OS-EXT-STS:power_state" >>> }, >>> { >>> "Value": null, >>> "Field": "OS-EXT-STS:task_state" >>> }, >>> { >>> "Value": "active", >>> "Field": "OS-EXT-STS:vm_state" >>> }, >>> { >>> "Value": "2015-09-30T08:37:55.000000", >>> "Field": "OS-SRV-USG:launched_at" >>> }, >>> { >>> "Value": null, >>> "Field": "OS-SRV-USG:terminated_at" >>> }, >>> { >>> "Value": "", >>> "Field": "accessIPv4" >>> }, >>> { >>> "Value": "", >>> "Field": "accessIPv6" >>> }, >>> { >>> "Value": "Ext-Net=167.114.225.193", >>> "Field": "addresses" >>> }, >>> { >>> "Value": "", >>> "Field": "config_drive" >>> }, >>> { >>> "Value": "2015-09-30T08:37:01Z", >>> "Field": "created" >>> }, >>> { >>> "Value": "vps-ssd-3 (e43d7458-6b82-4a78-a712-3a4dc6748cf4)", >>> "Field": "flavor" >>> }, >>> { >>> "Value": "38119f63edc62252c491fa7e9a8d164a90c48db09fdee1a5687c1c7f", >>> "Field": "hostId" >>> }, >>> { >>> "Value": "897cbcc9-d662-4ae9-bb68-a71ef4269cdc", >>> "Field": "id" >>> }, >>> { >>> "Value": "teuthology-centos-7.0 >>> (67438ecf-803c-45a6-83bb-54a0ba0d0b6c)", >>> "Field": "image" >>> }, >>> { >>> "Value": "teuthology", >>> "Field": "key_name" >>> }, >>> { >>> "Value": "target225193", >>> "Field": "name" >>> }, >>> { >>> "Value": [], >>> "Field": "os-extended-volumes:volumes_attached" >>> }, >>> { >>> "Value": 0, >>> "Field": "progress" >>> }, >>> { >>> "Value": "131b886b156a4f84b5f41baf2fbe646c", >>> "Field": "project_id" >>> }, >>> { >>> "Value": "ownedby='167.114.249.14', >>> teuthology='d48f8bc9adf785614308e33094933a72'", >>> "Field": "properties" >>> }, >>> { >>> "Value": [ >>> { >>> "name": "teuthology" >>> } >>> ], >>> "Field": "security_groups" >>> }, >>> { >>> "Value": "ACTIVE", >>> "Field": "status" >>> }, >>> { >>> "Value": "2015-09-30T08:39:08Z", >>> "Field": "updated" >>> }, >>> { >>> "Value": "291dde1633154837be2693c6ffa6315c", >>> "Field": "user_id" >>> } >>> ] >>> >>>> >>>> Thank you. >>>> >>>> Regards, >>>> M Bharath Krishna >>>> >>>> >>>> On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >>>> >>>>> Hi, >>>>> >>>>> On 28/09/2015 07:24, Bharath Krishna wrote: >>>>>> Hi Dachary, >>>>>> >>>>>> Thanks for the reply. I am following your blog >>>>>> http://dachary.org/?p=3767 >>>>>> And the README in >>>>>> >>>>>> >>>>>> >>>>>>https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#ope >>>>>>ns >>>>>> ta >>>>>> ck >>>>>> -backend >>>>> >>>>> The up to date instructions are at >>>>> >>>>>https://github.com/dachary/teuthology/tree/openstack/#openstack-backen >>>>>d >>>>> (the link you used comes from http://dachary.org/?p=3828 and I just >>>>> updated it so noone else will be confused). >>>>>> >>>>>> I have sourced the openrc file of my Openstack deployment and >>>>>>verified >>>>>> that clients are working fine. My Openstack deployment has Cinder >>>>>> integrated with CEPH backend. >>>>>> >>>>>> I have cloned and installed teuthology using the below steps: >>>>>> >>>>>> $ git clone -b wip-6502-openstack-v2 >>>>>> http://github.com/dachary/teuthology >>>>>> $ cd teuthology ; ./bootstrap install >>>>>> $ source virtualenv/bin/activate >>>>>> >>>>>> >>>>>> Then I tried to run a dummy suite as test and I ran into following >>>>>> error: >>>>>> >>>>>> Traceback (most recent call last): >>>>>> File "/root/teuthology/virtualenv/bin/teuthology-openstack", line >>>>>>9, >>>>>> in >>>>>> <module> >>>>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>>>> 'teuthology-openstack')() >>>>>> File "/root/teuthology/scripts/openstack.py", line 8, in main >>>>>> teuthology.openstack.main(parse_args(argv), argv) >>>>>> File "/root/teuthology/teuthology/openstack.py", line 375, in main >>>>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>>>> File "/root/teuthology/teuthology/openstack.py", line 181, in main >>>>>> self.verify_openstack() >>>>>> File "/root/teuthology/teuthology/openstack.py", line 270, in >>>>>> verify_openstack >>>>>> str(providers)) >>>>>> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is >>>>>> not a >>>>>> known OpenStack provider (('cloud.ovh.net', 'ovh'), >>>>>> ('control.os1.phx2', >>>>>> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") >>>>> >>>>> This limitation was in an earlier implementations and should not be a >>>>> problem now. >>>>> >>>>> Cheers >>>>> >>>>>> >>>>>> >>>>>> Thank you. >>>>>> >>>>>> Regards, >>>>>> M Bharath Krishna >>>>>> >>>>>> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >>>>>> >>>>>>> [moving to ceph-devel] >>>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> On 27/09/2015 21:20, Bharath Krishna wrote: >>>>>>>> Hi, >>>>>>>> >>>>>>>> We have an openstack deployment in place with CEPH as CINDER >>>>>>>> backend. >>>>>>>> >>>>>>>> We would like to perform functional testing for CEPH and found >>>>>>>> teuthology as recommended option. >>>>>>>> >>>>>>>> Have successfully installed teuthology. Now to integrate it with >>>>>>>> Openstack, I could see that the possible providers could be either >>>>>>>> OVH, >>>>>>>> REDHAT or ENTERCLOUDSITE. >>>>>>>> >>>>>>>> Is there any option where in we can source openstack deployment of >>>>>>>> our >>>>>>>> own and test CEPH using teuthology? >>>>>>> >>>>>>> The documentation mentions these providers because they have been >>>>>>> tested. >>>>>>> But there should be no blocker to run teuthology against a regular >>>>>>> OpenStack provider. Should you run into troubles, please let me >>>>>>>know >>>>>>> and >>>>>>> I'll help. >>>>>>> >>>>>>> Cheers >>>>>>> >>>>>>>> >>>>>>>> If NO, please suggest on how to test CEPH in such scenarios? >>>>>>>> >>>>>>>> Please help. >>>>>>>> >>>>>>>> Thank you. >>>>>>>> Bharath Krishna >>>>>>>> _______________________________________________ >>>>>>>> ceph-users mailing list >>>>>>>> ceph-users@lists.ceph.com >>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>>> >>>>>> >>>>> >>>>> -- >>>>> Loïc Dachary, Artisan Logiciel Libre >>>>> >>>> >>> >>> -- >>> Loïc Dachary, Artisan Logiciel Libre >>> >> > >-- >Loïc Dachary, Artisan Logiciel Libre > -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-30 10:17 ` Bharath Krishna @ 2015-09-30 10:35 ` Loic Dachary 2015-10-01 9:52 ` Loic Dachary 0 siblings, 1 reply; 10+ messages in thread From: Loic Dachary @ 2015-09-30 10:35 UTC (permalink / raw) To: Bharath Krishna, Ceph Development [-- Attachment #1: Type: text/plain, Size: 12142 bytes --] Could you send me privately the full log ? I suspect something else is happening (not a problem with tools / cluster version) and I may find a clue in the logs. On 30/09/2015 12:17, Bharath Krishna wrote: > Its the same version I do have as well. > > #openstack --version > openstack 1.7.0 > > > Thank you. > > Regards > M Bharath Krishna > > > > On 9/30/15, 3:42 PM, "Loic Dachary" <loic@dachary.org> wrote: > >> >> >> On 30/09/2015 11:34, Bharath Krishna wrote: >>> Hi Loic, >>> >>> Does piping the command output of "openstack server show -f json >>> <target-name>” to jq alter the output format? >> >> It just displays it nicely but does not otherwise change it. >> >> >>> >>> Openstack version being used is Juno. >> >> That's also the version of some of the clusters I use. What version of >> the openstack cli do you have ? >> >> $ openstack --version >> openstack 1.7.0 >> >> >>> >>> Thank you >>> >>> Regards, >>> M Bharath Krishna >>> >>> On 9/30/15, 2:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >>> >>>> Hi, >>>> >>>> On 30/09/2015 07:51, Bharath Krishna wrote: >>>>> Hi, >>>>> >>>>> Thanks a lot for pointing to right git and instructions. I have passed >>>>> that step now and teuthology VM got created. >>>>> >>>>> But teuthology openstack command fails to parse the instance id from >>>>> the >>>>> json format output of below command: >>>>> >>>>> DEBUG:teuthology.misc:openstack server show -f json teuthology output >>>>> >>>>> "OS-EXT-STS:task_state": null, >>>>> "addresses": ³Primary_External_Net=<ip-address>", >>>>> "image": "teuthology-ubuntu-14.04 >>>>> (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)", >>>>> "OS-EXT-STS:vm_state": "active", >>>>> "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8", >>>>> "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000", >>>>> "flavor": "m1.small (2)", >>>>> "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48", >>>>> "security_groups": [ >>>>> { >>>>> "name": "teuthology" >>>>> } >>>>> ], >>>>> "user_id": "281f9aa2d9c54177b45e72db742b4744", >>>>> "OS-DCF:diskConfig": "MANUAL", >>>>> "accessIPv4": "", >>>>> "accessIPv6": "", >>>>> "progress": 0, >>>>> "OS-EXT-STS:power_state": 1, >>>>> "OS-EXT-AZ:availability_zone": "az3", >>>>> "config_drive": "", >>>>> "status": "ACTIVE", >>>>> "updated": "2015-09-28T10:33:09Z", >>>>> "hostId": >>>>> "b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3", >>>>> "OS-EXT-SRV-ATTR:host": ³hostname", >>>>> "OS-SRV-USG:terminated_at": null, >>>>> "key_name": "ceph_test_key", >>>>> "properties": "", >>>>> "project_id": "1d0137fe585742bdbe13e2b16daab6ff", >>>>> "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname", >>>>> "name": "teuthology", >>>>> "created": "2015-09-28T10:32:47Z", >>>>> "os-extended-volumes:volumes_attached": [] >>>>> } >>>>> Traceback (most recent call last): >>>>> File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, >>>>> in >>>>> <module> >>>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>>> 'teuthology-openstack')() >>>>> File "/opt/teuthology/scripts/openstack.py", line 8, in main >>>>> teuthology.openstack.main(parse_args(argv), argv) >>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, >>>>> in >>>>> main >>>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, >>>>> in >>>>> main >>>>> ip = self.setup() >>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, >>>>> in >>>>> setup >>>>> if not self.cluster_exists(): >>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, >>>>> in >>>>> cluster_exists >>>>> instance_id = self.get_instance_id(self.args.name) >>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, >>>>> in >>>>> get_instance_id >>>>> return TeuthologyOpenStack.get_value(instance, 'id') >>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>>>> get_value >>>>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>>>> <lambda> >>>>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>>>> TypeError: string indices must be integers >>>>> >>>>> >>>>> I could understand that we are trying to get instance id value using >>>>> get_value method, but it fails with an exception even though instance >>>>> id >>>>> shown is a valid format of id. >>>>> >>>>> Any pointers to fix this will greatly help. >>>> >>>> It appears that the format of the json output is very different on your >>>> implementation. Here is the kind of output I get on all the clusters I >>>> tried. Which OpenStack version is your cluster running ? >>>> >>>> $ openstack server show -f json target225193 | jq . >>>> [ >>>> { >>>> "Value": "MANUAL", >>>> "Field": "OS-DCF:diskConfig" >>>> }, >>>> { >>>> "Value": "nova", >>>> "Field": "OS-EXT-AZ:availability_zone" >>>> }, >>>> { >>>> "Value": 1, >>>> "Field": "OS-EXT-STS:power_state" >>>> }, >>>> { >>>> "Value": null, >>>> "Field": "OS-EXT-STS:task_state" >>>> }, >>>> { >>>> "Value": "active", >>>> "Field": "OS-EXT-STS:vm_state" >>>> }, >>>> { >>>> "Value": "2015-09-30T08:37:55.000000", >>>> "Field": "OS-SRV-USG:launched_at" >>>> }, >>>> { >>>> "Value": null, >>>> "Field": "OS-SRV-USG:terminated_at" >>>> }, >>>> { >>>> "Value": "", >>>> "Field": "accessIPv4" >>>> }, >>>> { >>>> "Value": "", >>>> "Field": "accessIPv6" >>>> }, >>>> { >>>> "Value": "Ext-Net=167.114.225.193", >>>> "Field": "addresses" >>>> }, >>>> { >>>> "Value": "", >>>> "Field": "config_drive" >>>> }, >>>> { >>>> "Value": "2015-09-30T08:37:01Z", >>>> "Field": "created" >>>> }, >>>> { >>>> "Value": "vps-ssd-3 (e43d7458-6b82-4a78-a712-3a4dc6748cf4)", >>>> "Field": "flavor" >>>> }, >>>> { >>>> "Value": "38119f63edc62252c491fa7e9a8d164a90c48db09fdee1a5687c1c7f", >>>> "Field": "hostId" >>>> }, >>>> { >>>> "Value": "897cbcc9-d662-4ae9-bb68-a71ef4269cdc", >>>> "Field": "id" >>>> }, >>>> { >>>> "Value": "teuthology-centos-7.0 >>>> (67438ecf-803c-45a6-83bb-54a0ba0d0b6c)", >>>> "Field": "image" >>>> }, >>>> { >>>> "Value": "teuthology", >>>> "Field": "key_name" >>>> }, >>>> { >>>> "Value": "target225193", >>>> "Field": "name" >>>> }, >>>> { >>>> "Value": [], >>>> "Field": "os-extended-volumes:volumes_attached" >>>> }, >>>> { >>>> "Value": 0, >>>> "Field": "progress" >>>> }, >>>> { >>>> "Value": "131b886b156a4f84b5f41baf2fbe646c", >>>> "Field": "project_id" >>>> }, >>>> { >>>> "Value": "ownedby='167.114.249.14', >>>> teuthology='d48f8bc9adf785614308e33094933a72'", >>>> "Field": "properties" >>>> }, >>>> { >>>> "Value": [ >>>> { >>>> "name": "teuthology" >>>> } >>>> ], >>>> "Field": "security_groups" >>>> }, >>>> { >>>> "Value": "ACTIVE", >>>> "Field": "status" >>>> }, >>>> { >>>> "Value": "2015-09-30T08:39:08Z", >>>> "Field": "updated" >>>> }, >>>> { >>>> "Value": "291dde1633154837be2693c6ffa6315c", >>>> "Field": "user_id" >>>> } >>>> ] >>>> >>>>> >>>>> Thank you. >>>>> >>>>> Regards, >>>>> M Bharath Krishna >>>>> >>>>> >>>>> On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> On 28/09/2015 07:24, Bharath Krishna wrote: >>>>>>> Hi Dachary, >>>>>>> >>>>>>> Thanks for the reply. I am following your blog >>>>>>> http://dachary.org/?p=3767 >>>>>>> And the README in >>>>>>> >>>>>>> >>>>>>> >>>>>>> https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#ope >>>>>>> ns >>>>>>> ta >>>>>>> ck >>>>>>> -backend >>>>>> >>>>>> The up to date instructions are at >>>>>> >>>>>> https://github.com/dachary/teuthology/tree/openstack/#openstack-backen >>>>>> d >>>>>> (the link you used comes from http://dachary.org/?p=3828 and I just >>>>>> updated it so noone else will be confused). >>>>>>> >>>>>>> I have sourced the openrc file of my Openstack deployment and >>>>>>> verified >>>>>>> that clients are working fine. My Openstack deployment has Cinder >>>>>>> integrated with CEPH backend. >>>>>>> >>>>>>> I have cloned and installed teuthology using the below steps: >>>>>>> >>>>>>> $ git clone -b wip-6502-openstack-v2 >>>>>>> http://github.com/dachary/teuthology >>>>>>> $ cd teuthology ; ./bootstrap install >>>>>>> $ source virtualenv/bin/activate >>>>>>> >>>>>>> >>>>>>> Then I tried to run a dummy suite as test and I ran into following >>>>>>> error: >>>>>>> >>>>>>> Traceback (most recent call last): >>>>>>> File "/root/teuthology/virtualenv/bin/teuthology-openstack", line >>>>>>> 9, >>>>>>> in >>>>>>> <module> >>>>>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>>>>> 'teuthology-openstack')() >>>>>>> File "/root/teuthology/scripts/openstack.py", line 8, in main >>>>>>> teuthology.openstack.main(parse_args(argv), argv) >>>>>>> File "/root/teuthology/teuthology/openstack.py", line 375, in main >>>>>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>>>>> File "/root/teuthology/teuthology/openstack.py", line 181, in main >>>>>>> self.verify_openstack() >>>>>>> File "/root/teuthology/teuthology/openstack.py", line 270, in >>>>>>> verify_openstack >>>>>>> str(providers)) >>>>>>> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is >>>>>>> not a >>>>>>> known OpenStack provider (('cloud.ovh.net', 'ovh'), >>>>>>> ('control.os1.phx2', >>>>>>> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") >>>>>> >>>>>> This limitation was in an earlier implementations and should not be a >>>>>> problem now. >>>>>> >>>>>> Cheers >>>>>> >>>>>>> >>>>>>> >>>>>>> Thank you. >>>>>>> >>>>>>> Regards, >>>>>>> M Bharath Krishna >>>>>>> >>>>>>> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >>>>>>> >>>>>>>> [moving to ceph-devel] >>>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> On 27/09/2015 21:20, Bharath Krishna wrote: >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> We have an openstack deployment in place with CEPH as CINDER >>>>>>>>> backend. >>>>>>>>> >>>>>>>>> We would like to perform functional testing for CEPH and found >>>>>>>>> teuthology as recommended option. >>>>>>>>> >>>>>>>>> Have successfully installed teuthology. Now to integrate it with >>>>>>>>> Openstack, I could see that the possible providers could be either >>>>>>>>> OVH, >>>>>>>>> REDHAT or ENTERCLOUDSITE. >>>>>>>>> >>>>>>>>> Is there any option where in we can source openstack deployment of >>>>>>>>> our >>>>>>>>> own and test CEPH using teuthology? >>>>>>>> >>>>>>>> The documentation mentions these providers because they have been >>>>>>>> tested. >>>>>>>> But there should be no blocker to run teuthology against a regular >>>>>>>> OpenStack provider. Should you run into troubles, please let me >>>>>>>> know >>>>>>>> and >>>>>>>> I'll help. >>>>>>>> >>>>>>>> Cheers >>>>>>>> >>>>>>>>> >>>>>>>>> If NO, please suggest on how to test CEPH in such scenarios? >>>>>>>>> >>>>>>>>> Please help. >>>>>>>>> >>>>>>>>> Thank you. >>>>>>>>> Bharath Krishna >>>>>>>>> _______________________________________________ >>>>>>>>> ceph-users mailing list >>>>>>>>> ceph-users@lists.ceph.com >>>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>>>> >>>>>>> >>>>>> >>>>>> -- >>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>> >>>>> >>>> >>>> -- >>>> Loïc Dachary, Artisan Logiciel Libre >>>> >>> >> >> -- >> Loïc Dachary, Artisan Logiciel Libre >> > -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 198 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: Teuthology Integration to native openstack 2015-09-30 10:35 ` Loic Dachary @ 2015-10-01 9:52 ` Loic Dachary 0 siblings, 0 replies; 10+ messages in thread From: Loic Dachary @ 2015-10-01 9:52 UTC (permalink / raw) To: Bharath Krishna, Ceph Development [-- Attachment #1: Type: text/plain, Size: 13111 bytes --] Hi, I filed http://tracker.ceph.com/issues/13315 as a reminder regarding this problem. I believe you can fix it by de-installing the python-cliff package. If this is inconvenient, you could use strace -e open openstack flavor show -f json m1.tiny 2>&1 | grep json | grep cliff to find where the faulty json formatter comes from. Digging through the loading rules of http://docs.openstack.org/developer/stevedore/ should explain why it choses to load this one instead of the one from the virtualenv. Cheers On 30/09/2015 12:35, Loic Dachary wrote: > Could you send me privately the full log ? I suspect something else is happening (not a problem with tools / cluster version) and I may find a clue in the logs. > > On 30/09/2015 12:17, Bharath Krishna wrote: >> Its the same version I do have as well. >> >> #openstack --version >> openstack 1.7.0 >> >> >> Thank you. >> >> Regards >> M Bharath Krishna >> >> >> >> On 9/30/15, 3:42 PM, "Loic Dachary" <loic@dachary.org> wrote: >> >>> >>> >>> On 30/09/2015 11:34, Bharath Krishna wrote: >>>> Hi Loic, >>>> >>>> Does piping the command output of "openstack server show -f json >>>> <target-name>” to jq alter the output format? >>> >>> It just displays it nicely but does not otherwise change it. >>> >>> >>>> >>>> Openstack version being used is Juno. >>> >>> That's also the version of some of the clusters I use. What version of >>> the openstack cli do you have ? >>> >>> $ openstack --version >>> openstack 1.7.0 >>> >>> >>>> >>>> Thank you >>>> >>>> Regards, >>>> M Bharath Krishna >>>> >>>> On 9/30/15, 2:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >>>> >>>>> Hi, >>>>> >>>>> On 30/09/2015 07:51, Bharath Krishna wrote: >>>>>> Hi, >>>>>> >>>>>> Thanks a lot for pointing to right git and instructions. I have passed >>>>>> that step now and teuthology VM got created. >>>>>> >>>>>> But teuthology openstack command fails to parse the instance id from >>>>>> the >>>>>> json format output of below command: >>>>>> >>>>>> DEBUG:teuthology.misc:openstack server show -f json teuthology output >>>>>> >>>>>> "OS-EXT-STS:task_state": null, >>>>>> "addresses": ³Primary_External_Net=<ip-address>", >>>>>> "image": "teuthology-ubuntu-14.04 >>>>>> (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)", >>>>>> "OS-EXT-STS:vm_state": "active", >>>>>> "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8", >>>>>> "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000", >>>>>> "flavor": "m1.small (2)", >>>>>> "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48", >>>>>> "security_groups": [ >>>>>> { >>>>>> "name": "teuthology" >>>>>> } >>>>>> ], >>>>>> "user_id": "281f9aa2d9c54177b45e72db742b4744", >>>>>> "OS-DCF:diskConfig": "MANUAL", >>>>>> "accessIPv4": "", >>>>>> "accessIPv6": "", >>>>>> "progress": 0, >>>>>> "OS-EXT-STS:power_state": 1, >>>>>> "OS-EXT-AZ:availability_zone": "az3", >>>>>> "config_drive": "", >>>>>> "status": "ACTIVE", >>>>>> "updated": "2015-09-28T10:33:09Z", >>>>>> "hostId": >>>>>> "b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3", >>>>>> "OS-EXT-SRV-ATTR:host": ³hostname", >>>>>> "OS-SRV-USG:terminated_at": null, >>>>>> "key_name": "ceph_test_key", >>>>>> "properties": "", >>>>>> "project_id": "1d0137fe585742bdbe13e2b16daab6ff", >>>>>> "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname", >>>>>> "name": "teuthology", >>>>>> "created": "2015-09-28T10:32:47Z", >>>>>> "os-extended-volumes:volumes_attached": [] >>>>>> } >>>>>> Traceback (most recent call last): >>>>>> File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, >>>>>> in >>>>>> <module> >>>>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>>>> 'teuthology-openstack')() >>>>>> File "/opt/teuthology/scripts/openstack.py", line 8, in main >>>>>> teuthology.openstack.main(parse_args(argv), argv) >>>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, >>>>>> in >>>>>> main >>>>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, >>>>>> in >>>>>> main >>>>>> ip = self.setup() >>>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, >>>>>> in >>>>>> setup >>>>>> if not self.cluster_exists(): >>>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, >>>>>> in >>>>>> cluster_exists >>>>>> instance_id = self.get_instance_id(self.args.name) >>>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, >>>>>> in >>>>>> get_instance_id >>>>>> return TeuthologyOpenStack.get_value(instance, 'id') >>>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>>>>> get_value >>>>>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>>>>> File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in >>>>>> <lambda> >>>>>> return filter(lambda v: v['Field'] == field, result)[0]['Value'] >>>>>> TypeError: string indices must be integers >>>>>> >>>>>> >>>>>> I could understand that we are trying to get instance id value using >>>>>> get_value method, but it fails with an exception even though instance >>>>>> id >>>>>> shown is a valid format of id. >>>>>> >>>>>> Any pointers to fix this will greatly help. >>>>> >>>>> It appears that the format of the json output is very different on your >>>>> implementation. Here is the kind of output I get on all the clusters I >>>>> tried. Which OpenStack version is your cluster running ? >>>>> >>>>> $ openstack server show -f json target225193 | jq . >>>>> [ >>>>> { >>>>> "Value": "MANUAL", >>>>> "Field": "OS-DCF:diskConfig" >>>>> }, >>>>> { >>>>> "Value": "nova", >>>>> "Field": "OS-EXT-AZ:availability_zone" >>>>> }, >>>>> { >>>>> "Value": 1, >>>>> "Field": "OS-EXT-STS:power_state" >>>>> }, >>>>> { >>>>> "Value": null, >>>>> "Field": "OS-EXT-STS:task_state" >>>>> }, >>>>> { >>>>> "Value": "active", >>>>> "Field": "OS-EXT-STS:vm_state" >>>>> }, >>>>> { >>>>> "Value": "2015-09-30T08:37:55.000000", >>>>> "Field": "OS-SRV-USG:launched_at" >>>>> }, >>>>> { >>>>> "Value": null, >>>>> "Field": "OS-SRV-USG:terminated_at" >>>>> }, >>>>> { >>>>> "Value": "", >>>>> "Field": "accessIPv4" >>>>> }, >>>>> { >>>>> "Value": "", >>>>> "Field": "accessIPv6" >>>>> }, >>>>> { >>>>> "Value": "Ext-Net=167.114.225.193", >>>>> "Field": "addresses" >>>>> }, >>>>> { >>>>> "Value": "", >>>>> "Field": "config_drive" >>>>> }, >>>>> { >>>>> "Value": "2015-09-30T08:37:01Z", >>>>> "Field": "created" >>>>> }, >>>>> { >>>>> "Value": "vps-ssd-3 (e43d7458-6b82-4a78-a712-3a4dc6748cf4)", >>>>> "Field": "flavor" >>>>> }, >>>>> { >>>>> "Value": "38119f63edc62252c491fa7e9a8d164a90c48db09fdee1a5687c1c7f", >>>>> "Field": "hostId" >>>>> }, >>>>> { >>>>> "Value": "897cbcc9-d662-4ae9-bb68-a71ef4269cdc", >>>>> "Field": "id" >>>>> }, >>>>> { >>>>> "Value": "teuthology-centos-7.0 >>>>> (67438ecf-803c-45a6-83bb-54a0ba0d0b6c)", >>>>> "Field": "image" >>>>> }, >>>>> { >>>>> "Value": "teuthology", >>>>> "Field": "key_name" >>>>> }, >>>>> { >>>>> "Value": "target225193", >>>>> "Field": "name" >>>>> }, >>>>> { >>>>> "Value": [], >>>>> "Field": "os-extended-volumes:volumes_attached" >>>>> }, >>>>> { >>>>> "Value": 0, >>>>> "Field": "progress" >>>>> }, >>>>> { >>>>> "Value": "131b886b156a4f84b5f41baf2fbe646c", >>>>> "Field": "project_id" >>>>> }, >>>>> { >>>>> "Value": "ownedby='167.114.249.14', >>>>> teuthology='d48f8bc9adf785614308e33094933a72'", >>>>> "Field": "properties" >>>>> }, >>>>> { >>>>> "Value": [ >>>>> { >>>>> "name": "teuthology" >>>>> } >>>>> ], >>>>> "Field": "security_groups" >>>>> }, >>>>> { >>>>> "Value": "ACTIVE", >>>>> "Field": "status" >>>>> }, >>>>> { >>>>> "Value": "2015-09-30T08:39:08Z", >>>>> "Field": "updated" >>>>> }, >>>>> { >>>>> "Value": "291dde1633154837be2693c6ffa6315c", >>>>> "Field": "user_id" >>>>> } >>>>> ] >>>>> >>>>>> >>>>>> Thank you. >>>>>> >>>>>> Regards, >>>>>> M Bharath Krishna >>>>>> >>>>>> >>>>>> On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote: >>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> On 28/09/2015 07:24, Bharath Krishna wrote: >>>>>>>> Hi Dachary, >>>>>>>> >>>>>>>> Thanks for the reply. I am following your blog >>>>>>>> http://dachary.org/?p=3767 >>>>>>>> And the README in >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#ope >>>>>>>> ns >>>>>>>> ta >>>>>>>> ck >>>>>>>> -backend >>>>>>> >>>>>>> The up to date instructions are at >>>>>>> >>>>>>> https://github.com/dachary/teuthology/tree/openstack/#openstack-backen >>>>>>> d >>>>>>> (the link you used comes from http://dachary.org/?p=3828 and I just >>>>>>> updated it so noone else will be confused). >>>>>>>> >>>>>>>> I have sourced the openrc file of my Openstack deployment and >>>>>>>> verified >>>>>>>> that clients are working fine. My Openstack deployment has Cinder >>>>>>>> integrated with CEPH backend. >>>>>>>> >>>>>>>> I have cloned and installed teuthology using the below steps: >>>>>>>> >>>>>>>> $ git clone -b wip-6502-openstack-v2 >>>>>>>> http://github.com/dachary/teuthology >>>>>>>> $ cd teuthology ; ./bootstrap install >>>>>>>> $ source virtualenv/bin/activate >>>>>>>> >>>>>>>> >>>>>>>> Then I tried to run a dummy suite as test and I ran into following >>>>>>>> error: >>>>>>>> >>>>>>>> Traceback (most recent call last): >>>>>>>> File "/root/teuthology/virtualenv/bin/teuthology-openstack", line >>>>>>>> 9, >>>>>>>> in >>>>>>>> <module> >>>>>>>> load_entry_point('teuthology==0.1.0', 'console_scripts', >>>>>>>> 'teuthology-openstack')() >>>>>>>> File "/root/teuthology/scripts/openstack.py", line 8, in main >>>>>>>> teuthology.openstack.main(parse_args(argv), argv) >>>>>>>> File "/root/teuthology/teuthology/openstack.py", line 375, in main >>>>>>>> return TeuthologyOpenStack(ctx, teuth_config, argv).main() >>>>>>>> File "/root/teuthology/teuthology/openstack.py", line 181, in main >>>>>>>> self.verify_openstack() >>>>>>>> File "/root/teuthology/teuthology/openstack.py", line 270, in >>>>>>>> verify_openstack >>>>>>>> str(providers)) >>>>>>>> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is >>>>>>>> not a >>>>>>>> known OpenStack provider (('cloud.ovh.net', 'ovh'), >>>>>>>> ('control.os1.phx2', >>>>>>>> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))") >>>>>>> >>>>>>> This limitation was in an earlier implementations and should not be a >>>>>>> problem now. >>>>>>> >>>>>>> Cheers >>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> Thank you. >>>>>>>> >>>>>>>> Regards, >>>>>>>> M Bharath Krishna >>>>>>>> >>>>>>>> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote: >>>>>>>> >>>>>>>>> [moving to ceph-devel] >>>>>>>>> >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> On 27/09/2015 21:20, Bharath Krishna wrote: >>>>>>>>>> Hi, >>>>>>>>>> >>>>>>>>>> We have an openstack deployment in place with CEPH as CINDER >>>>>>>>>> backend. >>>>>>>>>> >>>>>>>>>> We would like to perform functional testing for CEPH and found >>>>>>>>>> teuthology as recommended option. >>>>>>>>>> >>>>>>>>>> Have successfully installed teuthology. Now to integrate it with >>>>>>>>>> Openstack, I could see that the possible providers could be either >>>>>>>>>> OVH, >>>>>>>>>> REDHAT or ENTERCLOUDSITE. >>>>>>>>>> >>>>>>>>>> Is there any option where in we can source openstack deployment of >>>>>>>>>> our >>>>>>>>>> own and test CEPH using teuthology? >>>>>>>>> >>>>>>>>> The documentation mentions these providers because they have been >>>>>>>>> tested. >>>>>>>>> But there should be no blocker to run teuthology against a regular >>>>>>>>> OpenStack provider. Should you run into troubles, please let me >>>>>>>>> know >>>>>>>>> and >>>>>>>>> I'll help. >>>>>>>>> >>>>>>>>> Cheers >>>>>>>>> >>>>>>>>>> >>>>>>>>>> If NO, please suggest on how to test CEPH in such scenarios? >>>>>>>>>> >>>>>>>>>> Please help. >>>>>>>>>> >>>>>>>>>> Thank you. >>>>>>>>>> Bharath Krishna >>>>>>>>>> _______________________________________________ >>>>>>>>>> ceph-users mailing list >>>>>>>>>> ceph-users@lists.ceph.com >>>>>>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com >>>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>>>>> >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Loïc Dachary, Artisan Logiciel Libre >>>>>>> >>>>>> >>>>> >>>>> -- >>>>> Loïc Dachary, Artisan Logiciel Libre >>>>> >>>> >>> >>> -- >>> Loïc Dachary, Artisan Logiciel Libre >>> >> > -- Loïc Dachary, Artisan Logiciel Libre [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 198 bytes --] ^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2015-10-01 9:52 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <D22E3F64.15AF%bkrishna@walmartlabs.com>
2015-09-27 20:17 ` Teuthology Integration to native openstack Loic Dachary
2015-09-28 5:24 ` Bharath Krishna
2015-09-28 9:50 ` Loic Dachary
2015-09-30 5:51 ` Bharath Krishna
2015-09-30 8:50 ` Loic Dachary
2015-09-30 9:34 ` Bharath Krishna
2015-09-30 10:12 ` Loic Dachary
2015-09-30 10:17 ` Bharath Krishna
2015-09-30 10:35 ` Loic Dachary
2015-10-01 9:52 ` Loic Dachary
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.