Elasticsearch cluster fails to deploy with mos-8

Bug #1599554 reported by Swann Croiset
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
StackLight
Fix Released
Critical
Simon Pasquier

Bug Description

with mos-8

Steps
=====
deploy 1 controller + 3 elasticsearch

Error
======

the task "provision-kibana-index" fails

2016-07-06 10:16:41 +0000 Puppet (debug): URL HEAD http://10.109.16.9:9200/.kibana/visualization/NUMBER-OF-LOG-MESSAGES-PER-ROLE?
2016-07-06 10:16:41 +0000 /Stage[main]/Lma_logging_analytics::Kibana_dashboards/Kibana_object[NUMBER-OF-LOG-MESSAGES-PER-ROLE] (err): Could not evaluate: Fail to retrieve object '/.kibana/vi
sualization/NUMBER-OF-LOG-MESSAGES-PER-ROLE' (HTTP response: 503/)

Diag
====
 curl -v 10.109.16.13:9200/_template
* Hostname was NOT found in DNS cache
* Trying 10.109.16.13...
* Connected to 10.109.16.13 (10.109.16.13) port 9200 (#0)
> GET /_template HTTP/1.1
> User-Agent: curl/7.35.0
> Host: 10.109.16.13:9200
> Accept: */*
>
< HTTP/1.1 503 Service Unavailable
< Content-Type: application/json; charset=UTF-8
< Content-Length: 151
<
* Connection #0 to host 10.109.16.13 left intact
{"error":{"root_cause":[{"type":"master_not_discovered_exception","reason":null}],"type":"master_not_discovered_exception","reason":null},"status":503}root@node-4:/etc/haproxy/conf.d#
(reverse-i-search)`l': curl -v 10.109.16.13:9200/_template

The ES cluster is not yet ready (waiting majority of nodes)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-plugin-elasticsearch-kibana (master)

Fix proposed to branch: master
Review: https://review.openstack.org/338917

Changed in lma-toolchain:
assignee: LMA-Toolchain Fuel Plugins (mos-lma-toolchain) → Swann Croiset (swann-w)
status: New → In Progress
Changed in lma-toolchain:
assignee: Swann Croiset (swann-w) → Simon Pasquier (simon-pasquier)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-plugin-elasticsearch-kibana (master)

Reviewed: https://review.openstack.org/338917
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-elasticsearch-kibana/commit/?id=b77f167342758ae3b12b448b996b250a6e770285
Submitter: Jenkins
Branch: master

commit b77f167342758ae3b12b448b996b250a6e770285
Author: Swann Croiset <email address hidden>
Date: Wed Jul 6 13:22:45 2016 +0200

    Fix the deployment order to support MOS 8

    Closes-bug: #1599554

    Change-Id: Id8b73d15e0ca4fbec63e9bc9049d7206f8ae850b

Changed in lma-toolchain:
status: In Progress → Fix Committed
Changed in lma-toolchain:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.