RabbitMQ logs are not being collected by Fluentd
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| kolla-ansible |
Fix Released
|
Medium
|
Lev Klimin | ||
| Rocky |
Fix Released
|
Medium
|
Mark Goddard | ||
| Stein |
Fix Released
|
Medium
|
Lev Klimin | ||
| Train |
Fix Released
|
Medium
|
Lev Klimin | ||
| Ussuri |
Fix Released
|
Medium
|
Lev Klimin | ||
Bug Description
The following report is based on a Centos deployment.
On Rocky:
* RabbitMQ log name defaults to `<email address hidden>`. The hostname is included by default because the log file name is not set in the Rabbit config. Fluentd is set to ingest the RabbitMQ log from `rabbit.log`, so it is never picked up.
* When the Fluentd config is fixed so that the log is ingested the pattern matching is broken, and Fluentd spits out parsing errors.
* We don't collect the SASL log
In Stein:
RabbitMQ is upgraded to 3.7.10 from 3.6.5
* The same issue with log file naming as in Rocky exists.
* The SASL log (which is not ingested in Rocky) becomes part of the main RabbitMQ log and the log format changes.
* An upgrade log now exists
* Crash logs now exist
The expected behaviour is at the very least Fluentd should ingest the main rabbitmq log so that we can alert on failures.
| Changed in kolla-ansible: | |
| assignee: | nobody → Doug Szumski (dszumski) |
| OpenStack Infra (hudson-openstack) wrote Fix proposed to kolla-ansible (master) | #1 |
| Changed in kolla-ansible: | |
| assignee: | Doug Szumski (dszumski) → Lev Klimin (lklimin) |
| status: | New → In Progress |
| Changed in kolla-ansible: | |
| importance: | Undecided → Medium |
| OpenStack Infra (hudson-openstack) wrote Fix merged to kolla-ansible (master) | #2 |
| Changed in kolla-ansible: | |
| status: | In Progress → Fix Released |
| OpenStack Infra (hudson-openstack) wrote Fix proposed to kolla-ansible (stable/train) | #3 |
| OpenStack Infra (hudson-openstack) wrote Fix proposed to kolla-ansible (stable/stein) | #4 |
| OpenStack Infra (hudson-openstack) wrote Fix merged to kolla-ansible (stable/train) | #5 |
| tags: | added: in-stable-train |
| OpenStack Infra (hudson-openstack) wrote Fix proposed to kolla-ansible (stable/rocky) | #6 |
| OpenStack Infra (hudson-openstack) wrote Fix merged to kolla-ansible (stable/stein) | #7 |
| OpenStack Infra (hudson-openstack) wrote Fix included in openstack/kolla-ansible 9.0.0.0rc2 | #8 |
| OpenStack Infra (hudson-openstack) wrote Fix included in openstack/kolla-ansible 7.2.0 | #9 |
| OpenStack Infra (hudson-openstack) wrote Fix included in openstack/kolla-ansible 8.1.0 | #10 |
Fix proposed to branch: master
Review: https:/