aggregated AFD are sent to Nagios but not displayed
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StackLight |
Confirmed
|
High
|
Simon Pasquier |
Bug Description
All AFD which are evaluated against already aggregated metrics are sent to Nagios but are not configured.
In nagios log, those entries appear continuously :
[2017-02-14 14:22:12] Warning: Passive check result was received for service 'keystone-
This concerns all AFD related to metrics listed in metrics.yaml (https:/
cinder-
cinder-
cinder-
cinder-
glance-
heat-api-check.vip
heat-cfn-
influxdb-
keystone-
neutron-
neutron-
neutron-l3.workers
neutron-
neutron-
nova-api-check.vip
nova-cert.workers
nova-compute.
nova-conductor.
nova-consoleaut
nova-free-
nova-free-
nova-scheduler.
rabbitmq-
swift-api-check.vip
swift-s3-
Workaround
==========
On the infrastructure-
# Discard Nagios messages about unsollicited passive check results
:msg, contains, "Warning: Passive check result was received for service" ~
Then restart rsyslogd:
/etc/init.
no longer affects: | lma-toolchain/1.0 |
Changed in lma-toolchain: | |
status: | New → Confirmed |
Changed in lma-toolchain: | |
importance: | Undecided → Low |
tags: | added: ct1 |
Changed in lma-toolchain: | |
importance: | Low → High |
description: | updated |
Changed in lma-toolchain: | |
assignee: | nobody → Simon Pasquier (simon-pasquier) |
It was reproduced on Fuel 9.2 StacLight 1.0
Deploy Fuel 9.0, upgrade it to 9.2, install SL plugins, deploy env.
Then
Check that you have the same files alarming.yaml and clusters.yaml on controllers and SL nodes
for i in $(fuel nodes | grep controller | awk {'print $1'}); do ssh node-$i 'md5sum /etc/hiera/ override/ alarming. yaml; md5sum /etc/hiera/ override/ clusters. yaml'; done
for i in $(fuel nodes | grep 'infrastructure _alerting' | awk {'print $1'}); do ssh node-$i override/ alarming. yaml; md5sum /etc/hiera/ override/ clusters. yaml'; done
'md5sum /etc/hiera/
cp /etc/nagios3/ conf.d/ lma_* .
rm -f /etc/nagios3/ conf.d/ lma_*
re-apply nagios manifest: /etc/fuel/ plugins/ lma_infrastruct ure_alerting- 1.0/puppet/ modules: /etc/puppet/ modules /etc/fuel/ plugins/ lma_infrastruct ure_alerting- 1.0/puppet/ manifests/ nagios. pp
puppet apply --modulepath=
Open Kibana UI and type into search field: "service could not be found", press search
May 8th 2017, 17:50:42.000 node-6 system.messages nagios3 INFO Warning: Passive check result was received for service 'keystone- public- api-check. vip' on host 'node-1', but the service could not be found! env-1 api-check. vip' on host 'node-1', but the service could not be found! env-1 cluster. pacemaker' on host 'node-1', but the service could not be found! env-1 th.workers' on host 'node-1', but the service could not be found! env-1 .workers' on host 'node-1', but the service could not be found! env-1 openvswitch. workers' on host 'node-1', but the service could not be found! env-1
May 8th 2017, 17:50:42.000 node-6 system.messages nagios3 INFO Warning: Passive check result was received for service 'glance-
May 8th 2017, 17:50:42.000 node-6 system.messages nagios3 INFO Warning: Passive check result was received for service 'rabbitmq-
May 8th 2017, 17:50:42.000 node-6 system.messages nagios3 INFO Warning: Passive check result was received for service 'nova-consoleau
May 8th 2017, 17:50:42.000 node-6 system.messages nagios3 INFO Warning: Passive check result was received for service 'nova-conductor
May 8th 2017, 17:50:42.000 node-6 system.messages nagios3 INFO Warning: Passive check result was received for service 'neutron-