Fuel for OpenStack

Comment 1 for bug 1652765

Revision history for this message

Alexander Ignatov (aignatov) wrote on 2016-12-28: Re: [9.1 swarm] Neutron failed to bind a port

Starting from 3:40 in logs on node 1 it's been constantly seeing logs where agent gets terminated

2016-12-27T03:40:19.605173+00:00 err: 2016-12-27 03:40:19.584 3701 ERROR neutron.agent.linux.utils [-] Exit code: 1; Stdin: hard_timeout=0,idle_timeout=0,priority=0,table=24,cookie=13505880170845670788,actions=drop; Stdout: ; Stderr: ovs-ofctl: br-int is not a bridge or
a socket
2016-12-27T03:40:19.605173+00:00 err: 2016-12-27 03:40:19.584 3701 ERROR neutron.agent.common.ovs_lib [-] Unable to execute ['ovs-ofctl', 'add-flows', 'br-int', '-']. Exception: Exit code: 1; Stdin: hard_timeout=0,idle_timeout=0,priority=0,table=24,cookie=135058801708456
70788,actions=drop; Stdout: ; Stderr: ovs-ofctl: br-int is not a bridge or a socket
2016-12-27T03:40:19.605173+00:00 debug: 2016-12-27 03:40:19.590 3701 DEBUG neutron.agent.linux.utils [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Running command (rootwrap daemon): ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', 'list-br'] execu
te_rootwrap_daemon /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:100
2016-12-27T03:40:19.605173+00:00 debug: 2016-12-27 03:40:19.603 3701 DEBUG neutron.agent.linux.utils [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Exit code: 0 execute /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:142
2016-12-27T03:40:19.605722+00:00 info: 2016-12-27 03:40:19.604 3701 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Mapping physical network physnet2 to bridge br-prv
2016-12-27T03:40:19.606037+00:00 err: 2016-12-27 03:40:19.604 3701 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Bridge br-prv for physical network physnet2 does not exist. Agent terminated!
2016-12-27T03:40:19.607427+00:00 info: 2016-12-27 03:40:19.606 3701 INFO oslo_rootwrap.client [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Stopping rootwrap daemon process with pid=3709

Starting from 3:40 in logs on node 1 it's been constantly seeing logs where agent gets terminated

2016-12-27T03:40:19.605173+00:00 err:  2016-12-27 03:40:19.584 3701 ERROR neutron.agent.linux.utils [-] Exit code: 1; Stdin: hard_timeout=0,idle_timeout=0,priority=0,table=24,cookie=13505880170845670788,actions=drop; Stdout: ; Stderr: ovs-ofctl: br-int is not a bridge or
a socket
2016-12-27T03:40:19.605173+00:00 err:  2016-12-27 03:40:19.584 3701 ERROR neutron.agent.common.ovs_lib [-] Unable to execute ['ovs-ofctl', 'add-flows', 'br-int', '-']. Exception: Exit code: 1; Stdin: hard_timeout=0,idle_timeout=0,priority=0,table=24,cookie=135058801708456
70788,actions=drop; Stdout: ; Stderr: ovs-ofctl: br-int is not a bridge or a socket
2016-12-27T03:40:19.605173+00:00 debug:  2016-12-27 03:40:19.590 3701 DEBUG neutron.agent.linux.utils [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Running command (rootwrap daemon): ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', 'list-br'] execu
te_rootwrap_daemon /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:100
2016-12-27T03:40:19.605173+00:00 debug:  2016-12-27 03:40:19.603 3701 DEBUG neutron.agent.linux.utils [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Exit code: 0 execute /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:142
2016-12-27T03:40:19.605722+00:00 info:  2016-12-27 03:40:19.604 3701 INFO neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Mapping physical network physnet2 to bridge br-prv
2016-12-27T03:40:19.606037+00:00 err:  2016-12-27 03:40:19.604 3701 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Bridge br-prv for physical network physnet2 does not exist. Agent terminated!
2016-12-27T03:40:19.607427+00:00 info:  2016-12-27 03:40:19.606 3701 INFO oslo_rootwrap.client [req-3da6051a-4253-4cae-a0bf-39fe8db2c969 - - - - -] Stopping rootwrap daemon process with pid=3709