Fuel Plugins

Zabbix: NTP Server service is down

Bug #1513454 reported by Swann Croiset
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel Plugins
Fix Committed
Undecided
Swann Croiset

Bug Description

on controllers, alert on the trigger "NTP Server service is down on  {HOST.NAME1}"

Trigger definition:
{Template Fuel OS Linux:net.udp.listen[123].last(0)}=0

The ntpd process doesn't listen UDP port 123 on Controllers nodes

Tested with MOS 7.0, and zabbix plugin master branch

See original description
Tags: plugin zabbix
Swann Croiset (swann-w)
Changed in fuel-plugins:
assignee: nobody → Fuel Plugin Zabbix (fuel-plugin-zabbix)
Swann Croiset (swann-w)
description: updated
Revision history for this message
Swann Croiset (swann-w) wrote :

Explanation:
The ntpd processes running on controller nodes listen on the vrouter network namespace
but the zabbix server runs on haproxy namespace and cannot see the effective binding of ntp.

Revision history for this message
Swann Croiset (swann-w) wrote :

in fact this is the zabbix-agent which doesn't see listening processes on vrouter namespace

Swann Croiset (swann-w)
Changed in fuel-plugins:
assignee: Fuel Plugin Zabbix (fuel-plugin-zabbix) → Swann Croiset (swann-w)
status: New → Fix Committed
Revision history for this message
Serg Lystopad (slystopad) wrote :

This bug also affects MOS 6.1 + plugin 1.0.1

> The ntpd process doesn't listen UDP port 123 on Controllers nodes
NTP listens UDP port 123 on Controllers, but ntpd is in vrouter network namespace:
# ip netns exec vrouter netstat -npul | grep ntp
udp 0 0 240.1.0.28:123 0.0.0.0:* 5693/ntpd
udp 0 0 240.0.0.6:123 0.0.0.0:* 5693/ntpd
udp 0 0 127.0.0.1:123 0.0.0.0:* 5693/ntpd
udp 0 0 0.0.0.0:123 0.0.0.0:* 5693/ntpd
udp6 0 0 fe80::9ce3:b5ff:fe8:123 :::* 5693/ntpd
udp6 0 0 fe80::8b:c0ff:fee5::123 :::* 5693/ntpd
udp6 0 0 ::1:123 :::* 5693/ntpd
udp6 0 0 :::123 :::* 5693/ntpd

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-plugin-external-zabbix (1.0)

Fix proposed to branch: 1.0
Review: https://review.openstack.org/276567

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-plugin-external-zabbix (1.0)

Related fix proposed to branch: 1.0
Review: https://review.openstack.org/276568

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Related fix proposed to branch: 1.0
Review: https://review.openstack.org/276569

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-plugin-external-zabbix (1.0)

Reviewed: https://review.openstack.org/276567
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-external-zabbix/commit/?id=6e87136d6d5fe5b23b96265de8411029fd9ddb43
Submitter: Jenkins
Branch: 1.0

commit 6e87136d6d5fe5b23b96265de8411029fd9ddb43
Author: Swann Croiset <email address hidden>
Date: Fri Nov 6 14:14:33 2015 +0100

    Remove the UDP listening check for NTP

    The template is linked to all nodes but ntpd running on controller nodes the
    check cannot be performed because zabbix-agent and ntpd processes run
    on different network namespaces.

    Fixes-bug: #1513454

    Change-Id: I3f305e00ad1e5b62cfd5d9741661cb398c892958
    (cherry picked from commit fc84cbc8d9d53da3d0d298b61a47436d9b980b06)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-plugin-external-zabbix (1.0)

Reviewed: https://review.openstack.org/276568
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-external-zabbix/commit/?id=d6b8b8589b2693ad5f01774b2f7faa342be5c8a8
Submitter: Jenkins
Branch: 1.0

commit d6b8b8589b2693ad5f01774b2f7faa342be5c8a8
Author: Swann Croiset <email address hidden>
Date: Fri Nov 6 14:48:45 2015 +0100

    Add check for ntpd binding on UDP port 123

    This check is performed on all nodes except for controller nodes.

    Related-bug: #1513454

    Change-Id: Iecf14599a01e66b35e57b5b7e656a4329545f39d
    (cherry picked from commit 9ab8c4ef8281a82d52833bc60aaed64ec069d523)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/276569
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-external-zabbix/commit/?id=c25a5d5ced67903eef511fc437496c6319ef51c9
Submitter: Jenkins
Branch: 1.0

commit c25a5d5ced67903eef511fc437496c6319ef51c9
Author: Swann Croiset <email address hidden>
Date: Sat Nov 7 14:08:52 2015 +0100

    Configure NTP check on controllers

    The check verifies that the ntpd process listens on port 123 on the
    vrouter network namespace.

    Related-bug: #1513454

    Change-Id: I45b2257dd584972a26643bf6f8cb34c4983be6e0
    (cherry picked from commit 7f3c3ecc743542dd4f027e0173e42d5dc82fc945)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.