I am running with the latest stable/liberty code and NSX Bumblebee RTQA27. During the stack process, it failed with when trying to create logical router port.
Neutron Log:
2016-02-22 21:11:40.786 ERROR vmware_nsx.plugins.nsx_v3.plugin [req-ca8f7a41-a332-475b-a3aa-3badcbfcbe64 None None] Failed to create port 95882095-a429-4bb7-afb2-50bb876f69c5 on NSX backend
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin Traceback (most recent call last):
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 788, in create_port
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin l2gw_port_check, is_psec_on)
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 706, in _create_port_at_the_backend
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin switch_profile_ids=profiles)
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/resources.py", line 265, in create
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin return self._client.create(body=body)
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 67, in create
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin return self.url_post('', body, headers=headers)
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 82, in url_post
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin return self._rest_call(url, method='POST', body=body, headers=headers)
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 161, in _rest_call
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin result = super(JSONRESTClient, self)._rest_call(*args, **kwargs)
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 138, in _rest_call
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin _("%(verb)s %(url)s") % {'verb': method, 'url': request_url})
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 102, in _validate_result
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin details=result_msg)
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin ResourceNotFound: Resource could not be found on backend (['10.116.244.188', '10.116.245.231', '10.116.250.143']) for POST api/v1/logical-ports
2016-02-22 21:11:40.786 TRACE vmware_nsx.plugins.nsx_v3.plugin
2016-02-22 21:11:40.825 ERROR oslo_messaging.rpc.dispatcher [req-ca8f7a41-a332-475b-a3aa-3badcbfcbe64 None None] Exception during message handling: Resource could not be found on backend (['10.116.244.188', '10.116.245.231', '10.116.250.143']) for POST api/v1/logical-ports
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher executor_callback))
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher executor_callback)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 147, in wrapper
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher ectxt.value = e.inner_exc
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 137, in wrapper
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher return f(*args, **kwargs)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 92, in wrapper
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher ret_val = f(_self, context, *args, **kwargs)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in create_dhcp_port
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher return self._port_action(plugin, context, port, 'create_port')
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 83, in _port_action
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher return p_utils.create_port(plugin, context, port)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/neutron/neutron/plugins/common/utils.py", line 140, in create_port
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher return core_plugin.create_port(context, {'port': port_data})
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 809, in create_port
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher neutron_db['id'])
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher six.reraise(self.type_, self.value, self.tb)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 788, in create_port
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher l2gw_port_check, is_psec_on)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 706, in _create_port_at_the_backend
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher switch_profile_ids=profiles)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/resources.py", line 265, in create
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher return self._client.create(body=body)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 67, in create
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher return self.url_post('', body, headers=headers)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 82, in url_post
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher return self._rest_call(url, method='POST', body=body, headers=headers)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 161, in _rest_call
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher result = super(JSONRESTClient, self)._rest_call(*args, **kwargs)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 138, in _rest_call
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher _("%(verb)s %(url)s") % {'verb': method, 'url': request_url})
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 102, in _validate_result
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher details=result_msg)
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher ResourceNotFound: Resource could not be found on backend (['10.116.244.188', '10.116.245.231', '10.116.250.143']) for POST api/v1/logical-ports
2016-02-22 21:11:40.825 TRACE oslo_messaging.rpc.dispatcher
2016-02-22 21:11:40.827 ERROR oslo_messaging._drivers.common [req-ca8f7a41-a332-475b-a3aa-3badcbfcbe64 None None] Returning exception Resource could not be found on backend (['10.116.244.188', '10.116.245.231', '10.116.250.143']) for POST api/v1/logical-ports to caller
2016-02-22 21:11:40.828 ERROR oslo_messaging._drivers.common [req-ca8f7a41-a332-475b-a3aa-3badcbfcbe64 None None] ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply\n executor_callback))\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch\n executor_callback)\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 129, in _do_dispatch\n result = func(ctxt, **new_args)\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 147, in wrapper\n ectxt.value = e.inner_exc\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 137, in wrapper\n return f(*args, **kwargs)\n', ' File "/opt/stack/neutron/neutron/quota/resource_registry.py", line 92, in wrapper\n ret_val = f(_self, context, *args, **kwargs)\n', ' File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 234, in create_dhcp_port\n return self._port_action(plugin, context, port, \'create_port\')\n', ' File "/opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py", line 83, in _port_action\n return p_utils.create_port(plugin, context, port)\n', ' File "/opt/stack/neutron/neutron/plugins/common/utils.py", line 140, in create_port\n return core_plugin.create_port(context, {\'port\': port_data})\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 809, in create_port\n neutron_db[\'id\'])\n', ' File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__\n six.reraise(self.type_, self.value, self.tb)\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 788, in create_port\n l2gw_port_check, is_psec_on)\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/plugins/nsx_v3/plugin.py", line 706, in _create_port_at_the_backend\n switch_profile_ids=profiles)\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/resources.py", line 265, in create\n return self._client.create(body=body)\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 67, in create\n return self.url_post(\'\', body, headers=headers)\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 82, in url_post\n return self._rest_call(url, method=\'POST\', body=body, headers=headers)\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 161, in _rest_call\n result = super(JSONRESTClient, self)._rest_call(*args, **kwargs)\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 138, in _rest_call\n _("%(verb)s %(url)s") % {\'verb\': method, \'url\': request_url})\n', ' File "/opt/stack/vmware-nsx/vmware_nsx/nsxlib/v3/client.py", line 102, in _validate_result\n details=result_msg)\n', "ResourceNotFound: Resource could not be found on backend (['10.116.244.188', '10.116.245.231', '10.116.250.143']) for POST api/v1/logical-ports\n"]