Re: Teuthology Integration to native openstack

[Loic Dachary <loic@dachary.org>]

[-- Attachment #1: Type: text/plain, Size: 9437 bytes --]

Hi,

On 30/09/2015 07:51, Bharath Krishna wrote:
> Hi,
> 
> Thanks a lot for pointing to right git and instructions. I have passed
> that step now and teuthology VM got created.
> 
> But teuthology openstack command fails to parse the instance id from the
> json format output of below command:
> 
> DEBUG:teuthology.misc:openstack server show -f json teuthology output
> 
>  "OS-EXT-STS:task_state": null,
>   "addresses": ³Primary_External_Net=<ip-address>",
>   "image": "teuthology-ubuntu-14.04
> (10e6d3b1-f94a-4220-a00f-3e3a13f349e0)",
>   "OS-EXT-STS:vm_state": "active",
>   "OS-EXT-SRV-ATTR:instance_name": "instance-000026e8",
>   "OS-SRV-USG:launched_at": "2015-09-28T10:33:09.000000",
>   "flavor": "m1.small (2)",
>   "id": "79a41b6f-f379-4d14-98ac-e73cb42cfa48",
>   "security_groups": [
>     {
>       "name": "teuthology"
>     }
>   ],
>   "user_id": "281f9aa2d9c54177b45e72db742b4744",
>   "OS-DCF:diskConfig": "MANUAL",
>   "accessIPv4": "",
>   "accessIPv6": "",
>   "progress": 0,
>   "OS-EXT-STS:power_state": 1,
>   "OS-EXT-AZ:availability_zone": "az3",
>   "config_drive": "",
>   "status": "ACTIVE",
>   "updated": "2015-09-28T10:33:09Z",
>   "hostId": "b205fbea7ee98ef482712db93325a1d7d44d7694a8ec9fce7df038c3",
>   "OS-EXT-SRV-ATTR:host": ³hostname",
>   "OS-SRV-USG:terminated_at": null,
>   "key_name": "ceph_test_key",
>   "properties": "",
>   "project_id": "1d0137fe585742bdbe13e2b16daab6ff",
>   "OS-EXT-SRV-ATTR:hypervisor_hostname": ³hostname",
>   "name": "teuthology",
>   "created": "2015-09-28T10:32:47Z",
>   "os-extended-volumes:volumes_attached": []
> }
> Traceback (most recent call last):
>   File "/opt/teuthology/virtualenv/bin/teuthology-openstack", line 9, in
> <module>
>     load_entry_point('teuthology==0.1.0', 'console_scripts',
> 'teuthology-openstack')()
>   File "/opt/teuthology/scripts/openstack.py", line 8, in main
>     teuthology.openstack.main(parse_args(argv), argv)
>   File "/opt/teuthology/teuthology/openstack/__init__.py", line 622, in
> main
>     return TeuthologyOpenStack(ctx, teuth_config, argv).main()
>   File "/opt/teuthology/teuthology/openstack/__init__.py", line 284, in
> main
>     ip = self.setup()
>   File "/opt/teuthology/teuthology/openstack/__init__.py", line 338, in
> setup
>     if not self.cluster_exists():
>   File "/opt/teuthology/teuthology/openstack/__init__.py", line 607, in
> cluster_exists
>     instance_id = self.get_instance_id(self.args.name)
>   File "/opt/teuthology/teuthology/openstack/__init__.py", line 565, in
> get_instance_id
>     return TeuthologyOpenStack.get_value(instance, 'id')
>   File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in
> get_value
>     return filter(lambda v: v['Field'] == field, result)[0]['Value']
>   File "/opt/teuthology/teuthology/openstack/__init__.py", line 75, in
> <lambda>
>     return filter(lambda v: v['Field'] == field, result)[0]['Value']
> TypeError: string indices must be integers
> 
> 
> I could understand that we are trying to get instance id value using
> get_value method, but it fails with an exception even though instance id
> shown is a valid format of id.
> 
> Any pointers to fix this will greatly help.

It appears that the format of the json output is very different on your implementation. Here is the kind of output I get on all the clusters I tried. Which OpenStack version is your cluster running ? 

$ openstack server show -f json target225193 | jq .
[
  {
    "Value": "MANUAL",
    "Field": "OS-DCF:diskConfig"
  },
  {
    "Value": "nova",
    "Field": "OS-EXT-AZ:availability_zone"
  },
  {
    "Value": 1,
    "Field": "OS-EXT-STS:power_state"
  },
  {
    "Value": null,
    "Field": "OS-EXT-STS:task_state"
  },
  {
    "Value": "active",
    "Field": "OS-EXT-STS:vm_state"
  },
  {
    "Value": "2015-09-30T08:37:55.000000",
    "Field": "OS-SRV-USG:launched_at"
  },
  {
    "Value": null,
    "Field": "OS-SRV-USG:terminated_at"
  },
  {
    "Value": "",
    "Field": "accessIPv4"
  },
  {
    "Value": "",
    "Field": "accessIPv6"
  },
  {
    "Value": "Ext-Net=167.114.225.193",
    "Field": "addresses"
  },
  {
    "Value": "",
    "Field": "config_drive"
  },
  {
    "Value": "2015-09-30T08:37:01Z",
    "Field": "created"
  },
  {
    "Value": "vps-ssd-3 (e43d7458-6b82-4a78-a712-3a4dc6748cf4)",
    "Field": "flavor"
  },
  {
    "Value": "38119f63edc62252c491fa7e9a8d164a90c48db09fdee1a5687c1c7f",
    "Field": "hostId"
  },
  {
    "Value": "897cbcc9-d662-4ae9-bb68-a71ef4269cdc",
    "Field": "id"
  },
  {
    "Value": "teuthology-centos-7.0 (67438ecf-803c-45a6-83bb-54a0ba0d0b6c)",
    "Field": "image"
  },
  {
    "Value": "teuthology",
    "Field": "key_name"
  },
  {
    "Value": "target225193",
    "Field": "name"
  },
  {
    "Value": [],
    "Field": "os-extended-volumes:volumes_attached"
  },
  {
    "Value": 0,
    "Field": "progress"
  },
  {
    "Value": "131b886b156a4f84b5f41baf2fbe646c",
    "Field": "project_id"
  },
  {
    "Value": "ownedby='167.114.249.14', teuthology='d48f8bc9adf785614308e33094933a72'",
    "Field": "properties"
  },
  {
    "Value": [
      {
        "name": "teuthology"
      }
    ],
    "Field": "security_groups"
  },
  {
    "Value": "ACTIVE",
    "Field": "status"
  },
  {
    "Value": "2015-09-30T08:39:08Z",
    "Field": "updated"
  },
  {
    "Value": "291dde1633154837be2693c6ffa6315c",
    "Field": "user_id"
  }
]

> 
> Thank you.
> 
> Regards,
> M Bharath Krishna
> 
> 
> On 9/28/15, 3:20 PM, "Loic Dachary" <loic@dachary.org> wrote:
> 
>> Hi,
>>
>> On 28/09/2015 07:24, Bharath Krishna wrote:
>>> Hi Dachary,
>>>
>>> Thanks for the reply. I am following your blog
>>> http://dachary.org/?p=3767
>>> And the README in
>>>
>>> https://github.com/dachary/teuthology/tree/wip-6502-openstack-v2/#opensta
>>> ck
>>> -backend
>>
>> The up to date instructions are at
>> https://github.com/dachary/teuthology/tree/openstack/#openstack-backend
>> (the link you used comes from http://dachary.org/?p=3828 and I just
>> updated it so noone else will be confused).
>>>
>>> I have sourced the openrc file of my Openstack deployment and verified
>>> that clients are working fine. My Openstack deployment has Cinder
>>> integrated with CEPH backend.
>>>
>>> I have cloned and installed teuthology using the below steps:
>>>
>>> $ git clone -b wip-6502-openstack-v2
>>> http://github.com/dachary/teuthology
>>> $ cd teuthology ; ./bootstrap install
>>> $ source virtualenv/bin/activate
>>>
>>>
>>> Then I tried to run a dummy suite as test and I ran into following
>>> error:
>>>
>>> Traceback (most recent call last):
>>>   File "/root/teuthology/virtualenv/bin/teuthology-openstack", line 9,
>>> in
>>> <module>
>>>     load_entry_point('teuthology==0.1.0', 'console_scripts',
>>> 'teuthology-openstack')()
>>>   File "/root/teuthology/scripts/openstack.py", line 8, in main
>>>     teuthology.openstack.main(parse_args(argv), argv)
>>>   File "/root/teuthology/teuthology/openstack.py", line 375, in main
>>>     return TeuthologyOpenStack(ctx, teuth_config, argv).main()
>>>   File "/root/teuthology/teuthology/openstack.py", line 181, in main
>>>     self.verify_openstack()
>>>   File "/root/teuthology/teuthology/openstack.py", line 270, in
>>> verify_openstack
>>>     str(providers))
>>> Exception: ('OS_AUTH_URL=http://<ip-address>:5000/v2.0', " does is not a
>>> known OpenStack provider (('cloud.ovh.net', 'ovh'), ('control.os1.phx2',
>>> 'redhat'), ('entercloudsuite.com', 'entercloudsuite'))")
>>
>> This limitation was in an earlier implementations and should not be a
>> problem now.
>>
>> Cheers
>>
>>>
>>>
>>> Thank you.
>>>
>>> Regards,
>>> M Bharath Krishna
>>>
>>> On 9/28/15, 1:47 AM, "Loic Dachary" <loic@dachary.org> wrote:
>>>
>>>> [moving to ceph-devel]
>>>>
>>>> Hi,
>>>>
>>>> On 27/09/2015 21:20, Bharath Krishna wrote:
>>>>> Hi,
>>>>>
>>>>> We have an openstack deployment in place with CEPH as CINDER backend.
>>>>>
>>>>> We would like to perform functional testing for CEPH and found
>>>>> teuthology as recommended option.
>>>>>
>>>>> Have successfully installed teuthology. Now to integrate it with
>>>>> Openstack, I could see that the possible providers could be either
>>>>> OVH,
>>>>> REDHAT or ENTERCLOUDSITE.
>>>>>
>>>>> Is there any option where in we can source openstack deployment of our
>>>>> own and test CEPH using teuthology?
>>>>
>>>> The documentation mentions these providers because they have been
>>>> tested.
>>>> But there should be no blocker to run teuthology against a regular
>>>> OpenStack provider. Should you run into troubles, please let me know
>>>> and
>>>> I'll help.
>>>>
>>>> Cheers
>>>>
>>>>>
>>>>> If NO, please suggest on how to test CEPH in such scenarios?
>>>>>
>>>>> Please help.
>>>>>
>>>>> Thank you.
>>>>> Bharath Krishna
>>>>> _______________________________________________
>>>>> ceph-users mailing list
>>>>> ceph-users@lists.ceph.com
>>>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>>>
>>>>
>>>> -- 
>>>> Loïc Dachary, Artisan Logiciel Libre
>>>>
>>>
>>
>> -- 
>> Loïc Dachary, Artisan Logiciel Libre
>>
> 

-- 
Loïc Dachary, Artisan Logiciel Libre


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 198 bytes --]