Device not found: exceptions in l3 grenade

This seems to be related to the port_delete() method in ovs_neutron_agent.py:

    def port_delete(self, context, **kwargs):
        port_id = kwargs.get('port_id')
        port = self.int_br.get_vif_port_by_id(port_id)
        # If port exists, delete it
        if port:
            self.int_br.delete_port(port.port_name)

This method was added and then removed and recently added again:
commit f87a74bfa83eeb859dfd047719622b54cdb5f68b
commit 294019139d575bd7144cfcc229c98c8497bfbf7c
commit d6a55c17360d1aa8ca91849199987ae71e8600ee

The method indiscriminately remove a port from the ovs bridge regardless if the port is added by the ovs agent or not. This is not right, and will result in tons of race conditions. Also have seen bug fixes that catch the exception and ignores it.

The original bug is https://bugs.launchpad.net/neutron/+bug/1333365: Deleting a VM port does not remove security rules associated to VM port in ip tables. I reverted the change and tried to see if the same issue would still exist. It turned out after deleting the VM, the iptables rules associated with it are also removed.

Therefore, I'm going to revert the change. I'll add the original bug fixers so that they can verify.

will keep the delete notifiers and topics, but only revert the change in ovs_neutron_agent.py and the unit test.

Fix proposed to branch: master
Review: https://review.openstack.org/178666

Fix proposed to branch: master
Review: https://review.openstack.org/179314

Reviewed: https://review.openstack.org/179314
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=e007167a700aa5b80ecb48adff0ac36bb330591d
Submitter: Jenkins
Branch: master

commit e007167a700aa5b80ecb48adff0ac36bb330591d
Author: Kevin Benton <email address hidden>
Date: Thu Apr 30 17:14:44 2015 -0700

    Don't delete port from bridge on delete_port event

    Commit d6a55c17360d1aa8ca91849199987ae71e8600ee added
    logic to the OVS agent to delete a port from the integration
    bridge when a port was deleted on the Neutron side. However,
    this led to several races where whoever created the initial
    port (e.g. Nova, L3 agent, DHCP agent) would be trying to
    remove the port from the bridge at the same time. These
    would result in ugly exceptions on one side or the other.

    The original commit was trying to address the problem where
    the port would maintain connectivity even though it was removed
    from the integration bridge.

    This patch addresses both cases by removing the iptables rules
    for the deleted port and putting it in the dead VLAN so it loses
    connectivity. However, it still leaves the port attached to the
    integration bridge so the original creator can delete it.

    Related-Bug: #1333365
    Closes-Bug: #1448148
    Change-Id: I7ae7750b7ac7d15325ed9f2d517ca171543b53be

Fix proposed to branch: stable/kilo
Review: https://review.openstack.org/187795

Reviewed: https://review.openstack.org/178666
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=0ace88fd4a75ff213dc36fd16c1f8e7080ab7d6d
Submitter: Jenkins
Branch: master

commit 0ace88fd4a75ff213dc36fd16c1f8e7080ab7d6d
Author: Robert Li <email address hidden>
Date: Fri May 8 11:08:45 2015 -0400

    Add VIF_DELETED notification event to Nova

    It's possible to delete a neutron port that is currently associated
    with an instance. When it happens, neutron should notify nova of the
    port deletion event so that Nova can take proper actions.

    Refer to I998b6bb80cc0a81d665b61b8c4a424d7219c666f for the nova patch
    that handles the event.

    Change-Id: Iff88cd12ae18017ef3e776821bcf3ecf3b4f052f
    Related-Bug: #1333365
    Related-Bug: #1448148

Reviewed: https://review.openstack.org/187795
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=81e043f72135682510727c9fa9bafe7efa676717
Submitter: Jenkins
Branch: stable/kilo

commit 81e043f72135682510727c9fa9bafe7efa676717
Author: Kevin Benton <email address hidden>
Date: Thu Apr 30 17:14:44 2015 -0700

    Don't delete port from bridge on delete_port event

    Commit d6a55c17360d1aa8ca91849199987ae71e8600ee added
    logic to the OVS agent to delete a port from the integration
    bridge when a port was deleted on the Neutron side. However,
    this led to several races where whoever created the initial
    port (e.g. Nova, L3 agent, DHCP agent) would be trying to
    remove the port from the bridge at the same time. These
    would result in ugly exceptions on one side or the other.

    The original commit was trying to address the problem where
    the port would maintain connectivity even though it was removed
    from the integration bridge.

    This patch addresses both cases by removing the iptables rules
    for the deleted port and putting it in the dead VLAN so it loses
    connectivity. However, it still leaves the port attached to the
    integration bridge so the original creator can delete it.

    Conflicts:
     neutron/plugins/openvswitch/agent/ovs_neutron_agent.py
     neutron/tests/unit/plugins/openvswitch/agent/test_ovs_neutron_agent.py
     neutron/tests/unit/plugins/openvswitch/test_ovs_tunnel.py

    Related-Bug: #1333365
    Closes-Bug: #1448148
    Change-Id: I7ae7750b7ac7d15325ed9f2d517ca171543b53be
    (cherry picked from commit e007167a700aa5b80ecb48adff0ac36bb330591d)

Fix proposed to branch: feature/pecan
Review: https://review.openstack.org/196701

Change abandoned by Kyle Mestery (<email address hidden>) on branch: feature/pecan
Review: https://review.openstack.org/196701
Reason: This is lacking the functional fix [1], so I'll propose a new merge commit which includes that one.

[1] https://review.openstack.org/#/c/196711/

Fix proposed to branch: feature/pecan
Review: https://review.openstack.org/196920

Reviewed: https://review.openstack.org/196920
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=7f759c077f8f860c13db92d2ea6b353ef6b70900
Submitter: Jenkins
Branch: feature/pecan

commit 8123144fadd7c5d5e6e56a76ea860512619a2cf6
Author: Moshe Levi <email address hidden>
Date: Sun Jun 28 14:37:14 2015 +0300

    Fix Consolidate sriov agent and driver code

    This patch add mising __init to mech_sriov/mech_driver/
    and update the setup.cfg to the new agent entrypoint

    Trivial Fix

    Change-Id: I53a527081feb78472f496675bbb3c5121d38a14a

commit 8942fccf02e6e179d47582fdb2792a1ca972da21
Author: Assaf Muller <email address hidden>
Date: Mon Jun 29 11:38:51 2015 -0400

    Remove failing SafeFixture tests

    The fixtures 1.3 release attempted to fix the fixtures resource
    leak issue, but failed to do so completely. Our own SafeFixture
    is still needed: The 1.3 release broke our SafeFixture tests,
    but not the usage of SafeFixture itself. This patch removes
    those failing tests for now to unbreak the gate. Jakub reported
    a bug on fixtures 1.3:
    https://bugs.launchpad.net/python-fixtures/+bug/1469759

    We will continue to use SafeFixture until that bug is fixed
    in fixtures, at which point we will be able to require
    fixtures > 1.3.

    Change-Id: I59457c3bb198ff86d5ad55a1e623d008f0034b8f
    Closes-Bug: #1469734

commit 71dffb0a2c1720cd8233a329d32958a0160dd6f5
Author: Kevin Benton <email address hidden>
Date: Mon Jun 29 08:27:41 2015 +0000

    Revert "Removed test_lib module"

    This reverts commit 9a6536de6e1a7fe9b2552adc142e254426b82b6f.

    We pulled all of the plugins out of the tree, many of which still inherit
    from neutron test classes. This change then stated that we no longer
    support testing other plugins. I think this is a bit premature and should
    have been discussed under the subject
    "Neutron plugins can't use neutron plugin unit tests" or something
    similar.

    Change-Id: I68318589f010b731574ea3bfa8df98492bab31fc

commit b20fd81dbd497e058384a0af065dd0f1fdc4c728
Author: Jakub Libosvar <email address hidden>
Date: Fri Jun 5 14:32:51 2015 +0000

    Refactor NetcatTester class

    Following capabilities were added:
       - used transport protocol is passed as a constant instead of bool
       - src port for testing was added
       - connection can be established explicitly
       - change constructor parameters of NetcatTester

    As a part of removing bool for protocol definition
    get_free_namespace_port() was also modified to match the behavior.

    Change-Id: Id2ec322e7f731c05a3754a65411c9a5d8b258126

commit 83e37980dcd0b2bad6d64dd2cb23bcd2891cafca
Author: jingliuqing <email address hidden>
Date: Sat Jun 27 13:41:54 2015 +0800

    Use REST rather than ReST

    Change-Id: I06c9deaab58c5ec13bfeec39fb8fd4b1fe21f42d

commit 1b60df85ba3ad442c2e4e7e52538e1b9a1bf9378
Author: Kevin Benton <email address hidden>
Date: Thu Jun 25 18:34:38 2015 -0700

    Add a double-mock guard to the base test case

    Use mock to patch mock with a check to prevent multiple active
    patches to the...