redis server not starting after provisoning Ubuntu14.04 With HA
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
Juniper Openstack | Status tracked in Trunk | |||||
R2.0 |
Fix Released
|
Critical
|
Raj Reddy | |||
Trunk |
Fix Released
|
Critical
|
Raj Reddy |
Bug Description
Redis server not starting after provisioning on a HA cluster.
Image 2.0 Build 16 , Icehouse Ubuntu 14.04
From the setup_all log , see that the server is started , but when we check the host , it is not running
grep -r redis-server setup_all_
2014-12-14 17:12:34:975378: [root@10.87.141.1] run: service redis-server stop
2014-12-14 17:12:34:975991: [root@10.87.141.1] out: Stopping redis-server: redis-server.
2014-12-14 17:12:36:077639: [root@10.87.141.1] run: service redis-server start
2014-12-14 17:12:36:136209: [root@10.87.141.1] out: Starting redis-server: redis-server.
2014-12-14 17:12:38:617522: [root@10.87.141.2] run: service redis-server stop
2014-12-14 17:12:38:617855: [root@10.87.141.2] out: Stopping redis-server: redis-server.
2014-12-14 17:12:39:771678: [root@10.87.141.2] run: service redis-server start
2014-12-14 17:12:39:826538: [root@10.87.141.2] out: Starting redis-server: redis-server.
2014-12-14 17:12:43:236943: [root@10.87.141.3] run: service redis-server stop
2014-12-14 17:12:43:237311: [root@10.87.141.3] out: Stopping redis-server: redis-server.
2014-12-14 17:12:44:422999: [root@10.87.141.3] run: service redis-server start
2014-12-14 17:12:44:474398: [root@10.87.141.3] out: Starting redis-server: redis-server.
root@cs-
redis-server is not running
root@cs-
== Contrail Control ==
supervisor-control: active
contrail-control active
contrail-
contrail-dns active
contrail-named active
== Contrail Analytics ==
supervisor-
contrail-
contrail-
contrail-collector initializing (Collector, Redis:From, Redis:To connection down)
contrail-
== Contrail Config ==
supervisor-config: active
contrail-api:0 active
contrail-
contrail-
contrail-schema initializing (Collector connection down)
contrail-
ifmap active
== Contrail Web UI ==
supervisor-webui: active
contrail-webui failed
contrail-
== Contrail Database ==
supervisor-
contrail-database active
== Contrail Support Services ==
supervisor-
rabbitmq-server active
redis-server log shows that it is getting shutdown
31034] 14 Dec 16:45:33.448 # Server started, Redis version 2.6.13
[31034] 14 Dec 16:45:33.448 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_
[31034] 14 Dec 16:45:33.448 * The server is now ready to accept connections on port 6379
[31034 | signal handler] (1418605955) Received SIGTERM, scheduling shutdown...
[31034] 14 Dec 17:12:35.047 # User requested shutdown...
[31034] 14 Dec 17:12:35.047 * Saving the final RDB snapshot before exiting.
[31034] 14 Dec 17:12:35.048 * DB saved on disk
[31034] 14 Dec 17:12:35.048 * Removing the pid file.
[31034] 14 Dec 17:12:35.048 # Redis is now ready to exit, bye bye...
description: | updated |
information type: | Proprietary → Public |
tags: | added: releasenote |
tags: | added: analytics ha provisioning |
sometimes it seems 'service redis-server start' that's called immediately after 'stop' is not taking effect
workaround is to check 'service redis-server status' after provisioning and do
'service redis-server start' as needed after provisioning is done