Need tuneable ovs_vsctl_timeout in ovs_agent.ini

Bug #1738123 reported by Drew Freiberger
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Neutron Gateway Charm
Triaged
Medium
Unassigned
OpenStack Neutron Open vSwitch Charm
Triaged
Medium
Unassigned

Bug Description

With a large amount of neutron agents we find we need to tune the ovs_vsctl_timeout in the DEFAULT section of /etc/neutron/plugins/ml2/openvswitch_agent.ini

A reasonable value on one of our clouds is 60 seconds. With a large ovs-vsctl delay, we end up with faulty states in neutron-l3 agents running active on two or three members of an ha router.

This config looks like:

[DEFAULT]
ovs_vsctl_timeout = 60

Please provide a configuration interface for this in the charm. Thank you.

Liam Young (gnuoy)
Changed in charm-neutron-gateway:
status: New → Confirmed
importance: Undecided → Medium
assignee: nobody → Liam Young (gnuoy)
Liam Young (gnuoy)
Changed in charm-neutron-openvswitch:
status: New → Confirmed
importance: Undecided → Medium
assignee: nobody → Liam Young (gnuoy)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-neutron-gateway (master)

Fix proposed to branch: master
Review: https://review.openstack.org/530801

Changed in charm-neutron-gateway:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-neutron-openvswitch (master)

Fix proposed to branch: master
Review: https://review.openstack.org/530867

Changed in charm-neutron-openvswitch:
status: Confirmed → In Progress
Revision history for this message
Drew Freiberger (afreiberger) wrote :

@gnuoy: We just realized that even hacking in this update to the /etc/neutron/plugins/ml2/openvswitch_agent.ini file, it fixes ovs agent, but does not fix neutron-l3-agent.

Can you add code into the charm-neutron-gateway project to handle appending --config-file=/etc/neutron/plugins/ml2/openvswitch_agent.ini if plugin in ['OVS', 'OVS_ODL'] into the service init file?

Note the startup command differences:

neutron 367937 8.1 0.0 569448 418396 ? Ss Jan03 104:41 /usr/bin/python /usr/bin/neutron-l3-agent --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/l3_agent.ini --config-file=/etc/neutron/fwaas_driver.ini --log-file=/var/log/neutron/neutron-l3-agent.log

neutron 883782 22.8 0.0 511724 355836 ? Ss 2017 2312:15 /usr/bin/python /usr/bin/neutron-openvswitch-agent --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/plugins/ml2/openvswitch_agent.ini --log-file=/var/log/neutron/neutron-openvswitch-agent.log

The neutron-l3-agent doesn't pull in the OVS configs, but DOES use ovsdb connections directly within the agent context.

Revision history for this message
James Page (james-page) wrote :

I'd probably just push the timeout value into the DEFAULT section of the neutron.conf file; if it applies to both n-ovs-agent and n-l3-agent thats fine.

Revision history for this message
Drew Freiberger (afreiberger) wrote :

popping this into neutron.conf will affect outages for conf changes in additional services I'd rather not impacted.

    NEUTRON_CONF: {
<snip>
        'services': ['neutron-l3-agent',
                     'neutron-dhcp-agent',
                     'neutron-metadata-agent',
                     'neutron-plugin-openvswitch-agent',
                     'neutron-plugin-metering-agent',
                     'neutron-metering-agent',
                     'neutron-lbaas-agent',
                     'neutron-vpn-agent']

I'd rather keep it in one conf and update the service init, or put it in the two specific conf files and limit the number of services restarted by config file refresh.

Changed in charm-neutron-gateway:
milestone: none → 18.02
Changed in charm-neutron-openvswitch:
milestone: none → 18.02
Ryan Beisner (1chb1n)
Changed in charm-neutron-gateway:
milestone: 18.02 → 18.05
Changed in charm-neutron-openvswitch:
milestone: 18.02 → 18.05
James Page (james-page)
Changed in charm-neutron-gateway:
milestone: 18.05 → 18.08
Changed in charm-neutron-openvswitch:
milestone: 18.05 → 18.08
James Page (james-page)
Changed in charm-neutron-gateway:
milestone: 18.08 → 18.11
Changed in charm-neutron-openvswitch:
milestone: 18.08 → 18.11
David Ames (thedac)
Changed in charm-neutron-gateway:
milestone: 18.11 → 19.04
Changed in charm-neutron-openvswitch:
milestone: 18.11 → 19.04
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on charm-neutron-gateway (master)

Change abandoned by Frode Nordahl (<email address hidden>) on branch: master
Review: https://review.openstack.org/530801
Reason: Marking this review as abandoned due to lack of activity in the past 6 months.
Feel free to restore it again if you want to pick up and continue the work.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on charm-neutron-openvswitch (master)

Change abandoned by Frode Nordahl (<email address hidden>) on branch: master
Review: https://review.openstack.org/530867
Reason: Marking this review as abandoned due to lack of activity in the past 6 months.
Feel free to restore it again if you want to pick up and continue the work.

David Ames (thedac)
Changed in charm-neutron-gateway:
milestone: 19.04 → 19.07
Changed in charm-neutron-openvswitch:
milestone: 19.04 → 19.07
David Ames (thedac)
Changed in charm-neutron-gateway:
milestone: 19.07 → 19.10
Changed in charm-neutron-openvswitch:
milestone: 19.07 → 19.10
Changed in charm-neutron-gateway:
assignee: Liam Young (gnuoy) → nobody
Changed in charm-neutron-openvswitch:
assignee: Liam Young (gnuoy) → nobody
David Ames (thedac)
Changed in charm-neutron-gateway:
milestone: 19.10 → 20.01
Changed in charm-neutron-openvswitch:
milestone: 19.10 → 20.01
James Page (james-page)
Changed in charm-neutron-gateway:
milestone: 20.01 → 20.05
Changed in charm-neutron-openvswitch:
milestone: 20.01 → 20.05
David Ames (thedac)
Changed in charm-neutron-gateway:
milestone: 20.05 → 20.08
Changed in charm-neutron-openvswitch:
milestone: 20.05 → 20.08
Bui Hong Ha (telescreen)
tags: added: sts
Revision history for this message
Edward Hope-Morley (hopem) wrote :

I'd like to rekindle this and update it for the more modern neutron. The config in the description of this bug refers to the older OFAgent driver which has been replaced since Newton with the "native" driver and therefore the config needed is:

[ovs]
...
of_connect_timeout = <timeout_secs>
of_request_timeout = <timeout_secs>

Changed in charm-neutron-gateway:
status: In Progress → New
Changed in charm-neutron-openvswitch:
status: In Progress → New
Changed in charm-neutron-gateway:
status: New → Triaged
Changed in charm-neutron-openvswitch:
status: New → Triaged
James Page (james-page)
Changed in charm-neutron-openvswitch:
milestone: 20.08 → none
James Page (james-page)
Changed in charm-neutron-gateway:
milestone: 20.08 → none
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.