[ubuntu-havana-R1.06-40] contrail-database service failure
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Juniper Openstack |
Fix Released
|
Critical
|
Megh Bhatt |
Bug Description
Team,
Contrail-database is in failure state on all 3 nodes with latest #40. Can someone look into?
Provision logs: http://
CFGM : [u'a6s32', u'a6s33']
Control Nodes : [u'a6s33', u'a6s38']
Compute Nodes : [u'a6s19', u'a6s22']
Collector : [u'a6s32']
WebUI : a6s32
OpenstackUI : a6s33
Logs:
2014-06-14 04:36:45,954 CRIT Supervisor running as root (no user in config file)
2014-06-14 04:36:45,954 INFO Increased RLIMIT_NOFILE limit to 10240
2014-06-14 04:36:45,971 INFO RPC interface 'supervisor' initialized
2014-06-14 04:36:45,972 CRIT Server 'inet_http_server' running without any HTTP authentication checking
2014-06-14 04:36:45,972 INFO RPC interface 'supervisor' initialized
2014-06-14 04:36:45,972 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2014-06-14 04:36:45,972 INFO supervisord started with pid 12636
2014-06-14 04:36:46,975 INFO spawned: 'contrail-
2014-06-14 04:36:46,976 INFO spawned: 'contrail-database' with pid 12659
2014-06-14 04:36:47,567 INFO exited: contrail-database (exit status 1; not expected)
2014-06-14 04:36:48,158 INFO success: contrail-
2014-06-14 04:36:49,160 INFO spawned: 'contrail-database' with pid 12720
2014-06-14 04:36:49,737 INFO exited: contrail-database (exit status 1; not expected)
2014-06-14 04:36:52,159 INFO spawned: 'contrail-database' with pid 12779
2014-06-14 04:36:52,742 INFO exited: contrail-database (exit status 1; not expected)
2014-06-14 04:36:56,168 INFO spawned: 'contrail-database' with pid 12835
2014-06-14 04:36:56,742 INFO exited: contrail-database (exit status 1; not expected)
2014-06-14 04:36:57,168 INFO gave up: contrail-database entered FATAL state, too many start retries too quickly
2014-06-14 Sat 05:21:07:056.910 PDT a6s32 [Thread 139732275201792, Pid 14629]: a6s32:Analytics
2014-06-14 Sat 05:21:07:056.942 PDT a6s32 [Thread 139732275201792, Pid 14629]: a6s32:Analytics
2014-06-14 Sat 05:21:07:057.002 PDT a6s32 [Thread 139732275201792, Pid 14629]: a6s32:Analytics
2014-06-14 Sat 05:21:07:175.249 PDT a6s32 [Thread 139732197570304, Pid 14629]: a6s32:Global: Initialize: Initializing..
2014-06-14 Sat 05:21:07:175.249 PDT a6s32 [Thread 139732275201792, Pid 14629]: a6s32:Analytics
2014-06-14 Sat 05:21:07:175.586 PDT a6s32 [Thread 139732197570304, Pid 14629]: a6s32:Global: Db_Init:
2014-06-14 Sat 05:21:07:175.630 PDT a6s32 [Thread 139732197570304, Pid 14629]: a6s32:Global: Initialize: Connection to DB FAILED
2014-06-14 Sat 05:21:07:175.653 PDT a6s32 [Thread 139732197570304, Pid 14629]: Init DB Handler initialization failed
2014-06-14 Sat 05:21:07:175.598 PDT a6s32 [Thread 139732275201792, Pid 14629]: a6s32:Analytics
2014-06-14 Sat 05:21:07:175.981 PDT a6s32 [Thread 139732275201792, Pid 14629]: a6s32:Analytics
2014-06-14 Sat 05:21:07:176.007 PDT a6s32 [Thread 139732275201792, Pid 14629]: a6s32:Analytics
root@a6s32:~# contrail-status
vRouter is NOT PRESENT
vRouter agent is NOT PRESENT
== Contrail Analytics ==
supervisor-
contrail-
contrail-collector active
contrail-opserver active
contrail-qe active
redis-query active
redis-uve active
== Contrail Config ==
supervisor-config: active
contrail-api:0 active
contrail-
contrail-
contrail-schema active
contrail-
ifmap active
== Contrail Web UI ==
supervisor-webui: active
contrail-webui active
contrail-
redis-webui active
== Contrail Database ==
supervisord-
contrail-database failed
contrail-
root@a6s32:~#
Changed in juniperopenstack: | |
assignee: | nobody → Raj Reddy (rajreddy) |
Changed in juniperopenstack: | |
assignee: | Raj Reddy (rajreddy) → Megh Bhatt (meghb) |
tags: | added: blocker |
information type: | Proprietary → Public |
Changed in juniperopenstack: | |
status: | Fix Committed → Fix Released |
Branch: refs/heads/R1.06 /github. com/Juniper/ contrail- packaging a26287a8216e973 7d3f4ac53c /github. com/Juniper/ contrail- packaging/ commit/ bd2c467ab19066a a26287a8216e973 7d3f4ac53c
Home: https:/
Commit: bd2c467ab19066a
https:/
Author: Raj Reddy <email address hidden>
Date: 2014-06-13 (Fri, 13 Jun 2014)
Changed paths: debian/ contrail- web-core/ debian/ rules
M common/
Log Message:
-----------
use Juniper logo for Juniper installations
Commit: 6ddea5aa0c6c8b4 0dd6b4566b629ed 693c3c8c96 /github. com/Juniper/ contrail- packaging/ commit/ 6ddea5aa0c6c8b4 0dd6b4566b629ed 693c3c8c96
https:/
Author: Megh Bhatt <email address hidden>
Date: 2014-06-14 (Sat, 14 Jun 2014)
Changed paths: packager/ common. py
M build/libs/
Log Message: com:Juniper/ contrail- packaging into R1.06
-----------
Merge branch 'R1.06' of github.
Commit: 45c5d416fc8f30c 3ccba01ca7dc2c1 8db840365f /github. com/Juniper/ contrail- packaging/ commit/ 45c5d416fc8f30c 3ccba01ca7dc2c1 8db840365f
https:/
Author: Megh Bhatt <email address hidden>
Date: 2014-06-14 (Sat, 14 Jun 2014)
Changed paths: debian/ contrail- openstack- database/ debian/ contrail- openstack- database. postinst
M common/
Log Message: d/cassandra only on install and not on
-----------
Fix issue with previous commit to remove /var/lib/cassandra
and /etc/init.
upgrade. postinst script is called with configure option.