OpenStack Compute (nova)

Unexpected API Error with Virtual Interface creation failed

Bug #1847408 reported by Rico Lin
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
New
Undecided
Unassigned

Bug Description

During checking heat job failure at https://0192e1baed07113a07bc-364710e13fd987d48278cddc9e42329d.ssl.cf2.rackcdn.com/569582/2/gate/heat-functional-orig-mysql-lbaasv2/3a3b5c7/job-output.txt

Unexpected API Error found in
https://0192e1baed07113a07bc-364710e13fd987d48278cddc9e42329d.ssl.cf2.rackcdn.com/569582/2/gate/heat-functional-orig-mysql-lbaasv2/3a3b5c7/logs/screen-n-api.txt.gz

Oct 08 16:41:58.733573 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: INFO nova.api.openstack.requestlog [None req-d795e47f-e8b5-4c7d-bb6a-ee9e9809eb3b demo demo] 158.69.70.147 "GET /compute/v2.1/servers/test_in_place_update" status: 404 len: 95 microversion: 2.79 time: 0.009925
Oct 08 16:41:58.734390 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: [pid: 6610|app: 0|req: 120/245] 158.69.70.147 () {60 vars in 1245 bytes} [Tue Oct 8 16:41:58 2019] GET /compute/v2.1/servers/test_in_place_update => generated 95 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi [None req-ec844008-6574-4600-9459-551bb8f3281a demo demo] Unexpected exception in API method: VirtualInterfaceCreateException_Remote: Virtual Interface creation failed
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: Traceback (most recent call last):
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/conductor/manager.py", line 135, in _object_dispatch
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return getattr(target, method)(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return fn(self, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/objects/virtual_interface.py", line 103, in create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: db_vif = db.virtual_interface_create(self._context, updates)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/api.py", line 706, in virtual_interface_create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return IMPL.virtual_interface_create(context, values)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 180, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return f(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 223, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return f(context, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1565, in virtual_interface_create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: raise exception.VirtualInterfaceCreateException()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: VirtualInterfaceCreateException: Virtual Interface creation failed
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: Traceback (most recent call last):
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: res = self.dispatcher.dispatch(message)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return self._do_dispatch(endpoint, method, ctxt, args)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: result = func(ctxt, **new_args)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 235, in inner
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return func(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/exception_wrapper.py", line 79, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: function_name, call_dict, binary, tb)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: self.force_reraise()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: six.reraise(self.type_, self.value, self.tb)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/exception_wrapper.py", line 69, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return f(self, context, *args, **kw)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/compute/utils.py", line 1372, in decorated_function
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return function(self, context, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/compute/manager.py", line 219, in decorated_function
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: kwargs['instance'], e, sys.exc_info())
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: self.force_reraise()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: six.reraise(self.type_, self.value, self.tb)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/compute/manager.py", line 207, in decorated_function
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return function(self, context, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/compute/manager.py", line 6571, in attach_interface
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: bind_host_id=bind_host_id, tag=tag)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1607, in allocate_port_for_instance
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: bind_host_id=bind_host_id, attach=True)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1033, in allocate_for_instance
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: bind_host_id, requested_ports_dict)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1162, in _update_ports_for_instance
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: vif.destroy()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: self.force_reraise()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: six.reraise(self.type_, self.value, self.tb)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1145, in _update_ports_for_instance
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: vifobj.create()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 210, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ctxt, self, fn.__name__, args, kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/conductor/rpcapi.py", line 246, in object_action
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: objmethod=objmethod, args=args, kwargs=kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 181, in call
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: transport_options=self.transport_options)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 129, in _send
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: transport_options=transport_options)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 646, in send
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: transport_options=transport_options)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 636, in _send
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: raise result
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: VirtualInterfaceCreateException_Remote: Virtual Interface creation failed
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: Traceback (most recent call last):
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/conductor/manager.py", line 135, in _object_dispatch
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return getattr(target, method)(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return fn(self, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/objects/virtual_interface.py", line 103, in create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: db_vif = db.virtual_interface_create(self._context, updates)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/api.py", line 706, in virtual_interface_create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return IMPL.virtual_interface_create(context, values)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 180, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return f(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 223, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: return f(context, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1565, in virtual_interface_create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: raise exception.VirtualInterfaceCreateException()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: VirtualInterfaceCreateException: Virtual Interface creation failed
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last):
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/api/openstack/wsgi.py", line 671, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/api/validation/__init__.py", line 110, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/api/validation/__init__.py", line 110, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/api/openstack/compute/attach_interfaces.py", line 169, in create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi instance, network_id, port_id, req_ip, tag=tag)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/api.py", line 204, in inner
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/api.py", line 152, in inner
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/api.py", line 4435, in attach_interface
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi requested_ip=requested_ip, tag=tag)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/rpcapi.py", line 535, in attach_interface
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return cctxt.call(ctxt, 'attach_interface', **kw)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 181, in call
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi transport_options=self.transport_options)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 129, in _send
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi transport_options=transport_options)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 646, in send
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi transport_options=transport_options)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 636, in _send
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi raise result
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi VirtualInterfaceCreateException_Remote: Virtual Interface creation failed
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last):
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/conductor/manager.py", line 135, in _object_dispatch
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return getattr(target, method)(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/objects/virtual_interface.py", line 103, in create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi db_vif = db.virtual_interface_create(self._context, updates)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/api.py", line 706, in virtual_interface_create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return IMPL.virtual_interface_create(context, values)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 180, in wrapper
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 223, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1565, in virtual_interface_create
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi raise exception.VirtualInterfaceCreateException()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi VirtualInterfaceCreateException: Virtual Interface creation failed
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last):
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi res = self.dispatcher.dispatch(message)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 274, in dispatch
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return self._do_dispatch(endpoint, method, ctxt, args)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi result = func(ctxt, **new_args)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 235, in inner
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/exception_wrapper.py", line 79, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi function_name, call_dict, binary, tb)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi self.force_reraise()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi six.reraise(self.type_, self.value, self.tb)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/exception_wrapper.py", line 69, in wrapped
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/utils.py", line 1372, in decorated_function
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/manager.py", line 219, in decorated_function
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi kwargs['instance'], e, sys.exc_info())
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi self.force_reraise()
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi six.reraise(self.type_, self.value, self.tb)
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.184054 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/manager.py", line 207, in decorated_function
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return function(self, context, *args, **kwargs)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/compute/manager.py", line 6571, in attach_interface
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi bind_host_id=bind_host_id, tag=tag)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1607, in allocate_port_for_instance
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi bind_host_id=bind_host_id, attach=True)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1033, in allocate_for_instance
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi bind_host_id, requested_ports_dict)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1162, in _update_ports_for_instance
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi vif.destroy()
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi self.force_reraise()
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi six.reraise(self.type_, self.value, self.tb)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 1145, in _update_ports_for_instance
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi vifobj.create()
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 210, in wrapper
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi ctxt, self, fn.__name__, args, kwargs)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/conductor/rpcapi.py", line 246, in object_action
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi objmethod=objmethod, args=args, kwargs=kwargs)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 181, in call
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi transport_options=self.transport_options)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 129, in _send
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi transport_options=transport_options)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 646, in send
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi transport_options=transport_options)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 636, in _send
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi raise result
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi VirtualInterfaceCreateException_Remote: Virtual Interface creation failed
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last):
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/conductor/manager.py", line 135, in _object_dispatch
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return getattr(target, method)(*args, **kwargs)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/objects/virtual_interface.py", line 103, in create
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi db_vif = db.virtual_interface_create(self._context, updates)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/api.py", line 706, in virtual_interface_create
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return IMPL.virtual_interface_create(context, values)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 180, in wrapper
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 223, in wrapped
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs)
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1565, in virtual_interface_create
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi raise exception.VirtualInterfaceCreateException()
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi VirtualInterfaceCreateException: Virtual Interface creation failed
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: ERROR nova.api.openstack.wsgi
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: INFO nova.api.openstack.wsgi [None req-ec844008-6574-4600-9459-551bb8f3281a demo demo] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: <class 'VirtualInterfaceCreateException_Remote'>
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: DEBUG nova.api.openstack.wsgi [None req-ec844008-6574-4600-9459-551bb8f3281a demo demo] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: <class 'VirtualInterfaceCreateException_Remote'> {{(pid=6611) __call__ /opt/stack/new/nova/nova/api/openstack/wsgi.py:941}}
Oct 08 16:42:02.259628 ubuntu-bionic-ovh-bhs1-0012213338 <email address hidden>[6609]: INFO nova.api.openstack.requestlog [None req-ec844008-6574-4600-9459-551bb8f3281a demo demo] 158.69.70.147 "POST /compute/v2.1/servers/5507e630-978d-4e1d-aef7-c9f75276e6fe/os-interface" status: 500 len: 212 microversion: 2.79 time: 5.895614

Revision history for this message
Matt Riedemann (mriedem) wrote :

I wonder if this is a duplicate of bug 1821088. I don't see the reason for the database exception in this case though.

Revision history for this message
Matt Riedemann (mriedem) wrote :

It's very strange that this doesn't show up in the logs:

https://github.com/openstack/nova/blob/961c2945491ebcea3cf1cb175a06d057155aa5a5/nova/db/sqlalchemy/api.py#L1564

Revision history for this message
Matt Riedemann (mriedem) wrote :

It also looks like this is pretty rare, it's only hitting on that one change:

http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22VirtualInterfaceCreateException%3A%20Virtual%20Interface%20creation%20failed%5C%22%20AND%20tags%3A%5C%22screen-n-api.txt%5C%22&from=7d

tags: added: db gate-failure
tags: added: neutron
removed: db
Revision history for this message
Matt Riedemann (mriedem) wrote :
Download full text (12.1 KiB)

I'm going to duplicate this against bug 1821088 because I found the same db error in the same change as the fingerprint on that bug:

https://0192e1baed07113a07bc-364710e13fd987d48278cddc9e42329d.ssl.cf2.rackcdn.com/569582/2/gate/heat-functional-orig-mysql-lbaasv2/3a3b5c7/logs/screen-n-cond-cell1.txt.gz

Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api [None req-ec844008-6574-4600-9459-551bb8f3281a demo demo] VIF creation failed with a database error.: DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, u"Duplicate entry 'fa:16:3e:9b:ef:68/a330febf-9041-4cbb-8ff4-916d13dd8d09-0' for key 'uniq_virtual_interfaces0address0deleted'")
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: [SQL: INSERT INTO virtual_interfaces (created_at, updated_at, deleted_at, deleted, address, network_id, instance_uuid, uuid, tag) VALUES (%(created_at)s, %(updated_at)s, %(deleted_at)s, %(deleted)s, %(address)s, %(network_id)s, %(instance_uuid)s, %(uuid)s, %(tag)s)]
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: [parameters: {'instance_uuid': u'5507e630-978d-4e1d-aef7-c9f75276e6fe', 'uuid': u'a330febf-9041-4cbb-8ff4-916d13dd8d09', 'deleted': 0, 'created_at': datetime.datetime(2019, 10, 8, 16, 41, 58, 70705), 'updated_at': None, 'network_id': None, 'tag': None, 'address': u'fa:16:3e:9b:ef:68/a330febf-9041-4cbb-8ff4-916d13dd8d09', 'deleted_at': None}]
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: (Background on this error at: http://sqlalche.me/e/gkpj)
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api Traceback (most recent call last):
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1562, in virtual_interface_create
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api vif_ref.save(context.session)
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 50, in save
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api session.flush()
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2470, in flush
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api self._flush(objects)
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2608, in _flush
Oct 08 16:41:58.166717 ubuntu-bionic-ovh-bhs1-0012213338 nova-conductor[15276]: ERROR nova.db.sqlalchemy.api transaction.rollback(_capture_exception=True)
Oct 08 16:41:58.170510 ubuntu-bionic-ovh-bhs1-0012213338 nova-cond...

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.