1、When I delete a cluster from the ui,it responses a successful message like "成功: Deleted cluster: cluster."
2、When I refresh the ui,the deleted cluster appears again
3、Error messages for /var/log/messages.There is an execption raised when the magnum-conductor try to call is_octavia_enabled
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: Failed validating 'type' in schema['properties']['identity']['properties']['password']['properties']['user']['properties']['password']:
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: {'type': 'string'}
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: On instance['identity']['password']['user']['password']:
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: None (HTTP 400) (Request-ID: req-84ad63c5-8b35-4dc6-b08b-a5556fa0d478)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone Traceback (most recent call last):
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/magnum/common/keystone.py", line 318, in is_octavia_enabled
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone octavia_svc = keystone.client.services.list(type='load-balancer')
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneclient/v3/services.py", line 93, in list
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneclient/base.py", line 86, in func
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone return f(*args, **new_kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneclient/base.py", line 448, in list
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone list_resp = self._list(url_query, self.collection_key)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneclient/base.py", line 141, in _list
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone resp, body = self.client.get(url, **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 386, in get
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone return self.request(url, 'GET', **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 545, in request
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone resp = super(LegacyJsonAdapter, self).request(*args, **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 248, in request
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone return self.session.request(url, method, **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 747, in request
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone auth_headers = self.get_auth_headers(auth)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 1158, in get_auth_headers
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone return auth.get_headers(self, **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/plugin.py", line 95, in get_headers
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone token = self.get_token(session)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 88, in get_token
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone return self.get_access(session).auth_token
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 134, in get_access
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone self.auth_ref = self.get_auth_ref(session)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 184, in get_auth_ref
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone authenticated=False, log=False, **rkwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 1106, in post
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone return self.request(url, 'POST', **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 943, in request
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone raise exceptions.from_response(resp, method, url)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone BadRequest: Invalid input for field 'identity/password/user/password': None is not of type 'string'
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone Failed validating 'type' in schema['properties']['identity']['properties']['password']['properties']['user']['properties']['password']:
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone {'type': 'string'}
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone On instance['identity']['password']['user']['password']:
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone None (HTTP 400) (Request-ID: req-84ad63c5-8b35-4dc6-b08b-a5556fa0d478)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.587 94972 ERROR magnum.common.keystone #033[00m
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server [req-47c36035-2ac3-44c3-8baa-dbb4badc1545 - - - - -] Exception during message handling: ServicesListFailed: Failed to list services.
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 160, in wrapper
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server result = f(*args, **kwargs)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/magnum/conductor/handlers/cluster_conductor.py", line 178, in cluster_delete
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server cluster_driver.delete_cluster(context, cluster)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/magnum/drivers/heat/driver.py", line 162, in delete_cluster
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server self.pre_delete_cluster(context, cluster)
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/magnum/drivers/heat/driver.py", line 313, in pre_delete_cluster
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server if keystone.is_octavia_enabled():
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/site-packages/magnum/common/keystone.py", line 321, in is_octavia_enabled
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server raise exception.ServicesListFailed()
Dec 25 05:17:28 openstack-magnum-k8s magnum-conductor: 2019-12-25 05:17:28.619 94972 ERROR oslo_messaging.rpc.server ServicesListFailed: Failed to list services.
4、The detail exception is as follows
Invalid input for field 'identity/password/user/password': None is not of type 'string'
5、Check the admin context,it may be invalid
from magnum.common import context
admin_context = context.make_admin_context()
keystone = KeystoneClientV3(admin_context)
admin_context: {'domain': None, 'project_domain': None, 'auth_token': None, 'resource_uuid': None, 'auth_url': None, 'domain_id': None, 'trust_id': None, 'read_only': False, 'auth_token_info': None, 'user_id': None, 'user_domain_id': None, 'system_scope': None, 'user_identity': u'- - - - -', 'domain_name': None, 'is_admin_project': True, 'project_id': None, 'user_name': None, 'user_domain_name': None, 'project_name': None, 'global_request_id': None, 'is_admin': True, 'user': None, 'password': None, 'all_tenants': False, 'tenant': None, 'show_deleted': False, 'roles': [], 'project': None, 'request_id': 'req-826c67e9-8a33-4653-853a-b1e7f814258e', 'user_domain': None}