Description of problem:
When certifying IBM SVC product with OSP 12 , when running test case
tempest.api.volume.admin.test_volumes_actions.VolumesActionsTest.test_force_detach_volume under cinder_volume catalog, we got failed with below notification
Response - Headers: {'status': '404', u'content-length': '111', 'content-location': 'http://192.168.24.13:8774/v2.1/servers/e239389f-bfd7-4365-a06a-5574014bf11a', u'x-compute-request-id': 'req-dce4ce7d-f3d8-46bb-8e89-00f4fbe785ba', u'vary': 'OpenStack-API-Version,X-OpenStack-Nova-API-Version', u'server': 'Apache', u'openstack-api-version': 'compute 2.1', u'connection': 'close', u'x-openstack-nova-api-version': '2.1', u'date': 'Fri, 24 Aug 2018 06:40:20 GMT', u'content-type': 'application/json; charset=UTF-8', u'x-openstack-request-id': 'req-dce4ce7d-f3d8-46bb-8e89-00f4fbe785ba'}
Body: {"itemNotFound": {"message": "Instance e239389f-bfd7-4365-a06a-5574014bf11a could not be found.", "code": 404}}
}}}
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/tempest/common/utils/__init__.py", line 89, in wrapper
return f(self, *func_args, **func_kwargs)
File "/usr/lib/python2.7/site-packages/tempest/api/volume/admin/test_volumes_actions.py", line 100, in test_force_detach_volume
attachment_id=attachment['attachment_id'])
File "/usr/lib/python2.7/site-packages/tempest/lib/services/volume/v2/volumes_client.py", line 307, in force_detach_volume
resp, body = self.post(url, post_body)
File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 279, in post
return self.request('POST', url, extra_headers, headers, body, chunked)
File "/usr/lib/python2.7/site-packages/tempest/lib/services/volume/base_client.py", line 38, in request
method, url, extra_headers, headers, body, chunked)
File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 668, in request
self._error_checker(resp, resp_body)
File "/usr/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 845, in _error_checker
message=message)
tempest.lib.exceptions.ServerFault: Got server fault
Details: The server has either erred or is incapable of performing the requested operation.
Below is the cinder/volume.log output when case is failing :
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager [req-22648e16-335c-4091-a30d-9a6e2a89436e e4c824a78d2e49bdb3eb750df50c139f fe18157af8814b7ab94473ccd9943edc - default default] Terminate volume connection failed: argument of type 'NoneType' is not iterable: TypeError: argument of type 'NoneType' is not iterable
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager Traceback (most recent call last):
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1768, in terminate_connection
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager force=force)
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/zonemanager/utils.py", line 104, in decorator
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager conn_info = terminate_connection(self, *args, **kwargs)
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/ibm/storwize_svc/storwize_svc_fc.py", line 254, in terminate_connection
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager host = connector['host'] if 'host' in connector else ""
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager TypeError: argument of type 'NoneType' is not iterable
2018-08-22 02:11:38.811 39124 ERROR cinder.volume.manager
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server [req-22648e16-335c-4091-a30d-9a6e2a89436e e4c824a78d2e49bdb3eb750df50c139f fe18157af8814b7ab94473ccd9943edc - default default] Exception during message handling: VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Terminate volume connection failed: argument of type 'NoneType' is not iterable
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 160, in _process_incoming
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 213, in dispatch
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 183, in _do_dispatch
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1773, in terminate_connection
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server raise exception.VolumeBackendAPIException(data=err_msg)
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Terminate volume connection failed: argument of type 'NoneType' is not iterable
2018-08-22 02:11:38.813 39124 ERROR oslo_messaging.rpc.server