Avoid controller restart when port is not present in Trunk

2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif [-] Error happened during subport removal from trunk 82e80937-e69c-48a2-815f-e165ddb4c85e: openstack.excep
tions.ResourceNotFound: ResourceNotFound: 404: Client Error for url: https://10.46.23.16:13696/v2.0/trunks/82e80937-e69c-48a2-815f-e165ddb4c85e/remove_subports, SubPort on trunk 82e80937-e69
c-48a2-815f-e165ddb4c85e with parent port 7702cd15-0de1-45c8-a934-7bc20166364d could not be found.
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif Traceback (most recent call last):
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif File "/usr/local/lib/python3.6/site-packages/kuryr_kubernetes/controller/drivers/nested_vlan_vif.py", li
ne 271, in _remove_subports
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif os_net.delete_trunk_subports(trunk_id, subports_body)
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif File "/usr/local/lib/python3.6/site-packages/kuryr_kubernetes/clients.py", line 134, in _delete_trunk_su
bports
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif os_exc.raise_from_response(response)
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif File "/usr/local/lib/python3.6/site-packages/openstack/exceptions.py", line 238, in raise_from_response
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif http_status=http_status, request_id=request_id
2021-11-18 13:45:46.771 1 ERROR kuryr_kubernetes.controller.drivers.nested_vlan_vif openstack.exceptions.ResourceNotFound: ResourceNotFound: 404: Client Error for url: https://10.46.23.16:13
696/v2.0/trunks/82e80937-e69c-48a2-815f-e165ddb4c85e/remove_subports, SubPort on trunk 82e80937-e69c-48a2-815f-e165ddb4c85e with parent port 7702cd15-0de1-45c8-a934-7bc20166364d could not be
 found.