Fuel for OpenStack

Unable to switch fuel rsyslog to udp

  1. Series newton
  2. Bug #1651437
Bug #1651437 reported by Dmitriy Stremkovskiy
22
This bug affects 5 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
Medium
Michael Polenchuk
Fuel for OpenStack 11.0
Nominated for Ocata by Oleksiy Molchanov
Mitaka
Fix Released
Medium
Sergii Rizvan
Fuel for OpenStack 9.2-mu-2
Newton
Fix Committed
Medium
Michael Polenchuk
Fuel for OpenStack 10.1

Bug Description

Detailed bug description:
By default mos deployed cloud uses tcp for transporting logs from nodes to fuel master.
This may degrade performance of a cloud or even crush it.
Option in fuel ui does not switch it to udp. It switches proto for remote rsyslog server only.

Steps to reproduce:
Deploy MOS9.1 cloud, using remote rsyslog server in udp mode
tcpdump on admin interface on fuel node for messages coming to rsyslog server (usualy 514/tcp).
You should see packets.

Expected:
Another ui option, that switches to udp rsyslog messages from nodes to fuel node.
Logs delivered via udp not tcp.

Actual:
Logs are delivered via tcp not udp.

Workaround:
manual reconfiguration of fuel rsyslog and nodes to use udp transport.

Impact:
Degrade performance of a cloud or even crush it.

LAB:
MOS9.1 any + remote rsyslog server in udp mode

Andrey Kirilochkin (andreika-mail)
tags: added: customer-found
Oleksiy Molchanov (omolchanov)
Changed in fuel:
status: New → Confirmed
importance: Undecided → Medium
assignee: nobody → Fuel Sustaining (fuel-sustaining-team)
milestone: none → 11.0
tags: added: area-library
Michael Polenchuk (mpolenchuk)
Changed in fuel:
assignee: Fuel Sustaining (fuel-sustaining-team) → Michael Polenchuk (mpolenchuk)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/414948

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
Michael Polenchuk (mpolenchuk) wrote :

Use the following steps to change rsyslog transport once patch get merged:
# fuel --env X deployment default
# vi deployment_X/common.yaml
base_syslog:
  ...
  syslog_transport: udp

# fuel --env X deployment upload

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/415841

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/414948
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=792fb2af2298bc4f2b674aabaf658ef8c740fb87
Submitter: Jenkins
Branch: master

commit 792fb2af2298bc4f2b674aabaf658ef8c740fb87
Author: Michael Polenchuk <email address hidden>
Date: Mon Dec 26 16:08:23 2016 +0400

    Bring in syslog transport option

    Add option to set syslog transport by means of
    deployment facts modification:
      base_syslog:
        syslog_transport: udp | tcp

    DocImpact
    Closes-Bug: #1651437
    Change-Id: I944ca4617b0dc754188cf9835d590e0666d9f2bf

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/newton)

Reviewed: https://review.openstack.org/415841
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=0edcd49c2eaeab550b43db3efec3480d5183a800
Submitter: Jenkins
Branch: stable/newton

commit 0edcd49c2eaeab550b43db3efec3480d5183a800
Author: Michael Polenchuk <email address hidden>
Date: Mon Dec 26 16:08:23 2016 +0400

    Bring in syslog transport option

    Add option to set syslog transport by means of
    deployment facts modification:
      base_syslog:
        syslog_transport: udp | tcp

    DocImpact
    Closes-Bug: #1651437
    Change-Id: I944ca4617b0dc754188cf9835d590e0666d9f2bf

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/fuel-library 11.0.0.0rc1

This issue was fixed in the openstack/fuel-library 11.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/447003

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/mitaka)

Reviewed: https://review.openstack.org/447003
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=a1e3e168962fbfa26bd4187bf9c1447d2d59181c
Submitter: Jenkins
Branch: stable/mitaka

commit a1e3e168962fbfa26bd4187bf9c1447d2d59181c
Author: Michael Polenchuk <email address hidden>
Date: Mon Dec 26 16:08:23 2016 +0400

    Bring in syslog transport option

    Add option to set syslog transport by means of
    deployment facts modification:
      base_syslog:
        syslog_transport: udp | tcp

    DocImpact
    Depends-On: I19c307d795236e588eb99d7f81dcb10d79ff7da7
    Closes-Bug: #1651437
    Change-Id: I944ca4617b0dc754188cf9835d590e0666d9f2bf

TatyanaGladysheva (tgladysheva)
tags: added: on-verification
Revision history for this message
TatyanaGladysheva (tgladysheva) wrote :

Verified on 9.2 + mu2 updates.

Actual results before and after the fix:
http://paste.openstack.org/show/609904/

tags: removed: on-verification
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.