heat does not read sql db config option
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Heat |
Fix Released
|
Medium
|
Ian McLeod | ||
Havana |
Fix Released
|
Medium
|
Ian McLeod |
Bug Description
We need to tune connections to database and AMQP.
Some of those options include daemons startup behavior and specifically:
max_retries = -1
retry_interval = 1
to allow the daemon to continue retrying connecting.
[database]
# maximum db connection retries during startup. (setting -1
# implies an infinite retry count) (integer value)
max_retries=-1
# interval between retries of opening a sql connection
# (integer value)
retry_interval=1
[root@rhos4-heat1 heat]# /etc/init.
with mysql down, will result in a traceback (this is with or without max_retries/
ideally there should be no traceback, and instead the daemon should retry until the database is available.
Changed in heat: | |
status: | New → Triaged |
importance: | Undecided → Medium |
Changed in heat: | |
milestone: | none → icehouse-3 |
status: | Fix Committed → Fix Released |
Changed in heat: | |
milestone: | icehouse-3 → 2014.1 |
I can't reproduce this with latest master:
# maximum db connection retries during startup. (setting -1
# implies an infinite retry count) (integer value)
max_retries=10
# interval between retries of opening a sql connection
# (integer value)
retry_interval=10
2014-02-05 15:35:38.534 11265 INFO heat.openstack. common. rpc.impl_ qpid [-] Connected to AMQP server on localhost:5672 common. rpc.service [-] Creating Consumer connection for Service engine start /home/shardy/ git/heat/ heat/openstack/ common/ rpc/service. py:48 common. db.sqlalchemy. session [req-9c32cb73- 9953-4dd1- 9277-fc3b4e0d53 16 None] This application has not enabled MySQL traditional mode, which means silent data corruption may occur. Please encourage the application developers to enable this mode. common. db.sqlalchemy. session [req-9c32cb73- 9953-4dd1- 9277-fc3b4e0d53 16 None] SQL connection failed. 10 attempts left. common. db.sqlalchemy. session [req-9c32cb73- 9953-4dd1- 9277-fc3b4e0d53 16 None] SQL connection failed. 9 attempts left. common. db.sqlalchemy. session [req-9c32cb73- 9953-4dd1- 9277-fc3b4e0d53 16 None] SQL connection failed. 8 attempts left. common. db.sqlalchemy. session [req-9c32cb73- 9953-4dd1- 9277-fc3b4e0d53 16 None] SQL connection failed. 7 attempts left.
2014-02-05 15:35:38.535 11265 DEBUG heat.openstack.
2014-02-05 15:35:38.552 11265 WARNING heat.openstack.
2014-02-05 15:35:38.555 11265 WARNING heat.openstack.
2014-02-05 15:35:48.557 11265 WARNING heat.openstack.
2014-02-05 15:35:58.559 11265 WARNING heat.openstack.
2014-02-05 15:36:08.561 11265 WARNING heat.openstack.
And with the exact settings mentioned above:
# maximum db connection retries during startup. (setting -1
# implies an infinite retry count) (integer value)
max_retries=-1
# interval between retries of opening a sql connection
# (integer value)
retry_interval=1
2014-02-05 15:38:44.461 11675 INFO heat.openstack. common. rpc.impl_ qpid [-] Connected to AMQP server on localhost:5672 common. rpc.service [-] Creating Consumer connection for Service engine start /home/shardy/ git/heat/ heat/openstack/ common/ rpc/service. py:48 common. db.sqlalchemy. session [req-bd52823e- 0de8-475c- ad87-7c0f10818f 58 None] This application has not enabled MySQL traditional mode, which means silent data corruption may occur. Please encourage the application developers to enable this mode. common. db.sqlalchemy. session [req-bd52823e- 0de8-475c- ad87-7c0f10818f 58 None] SQL connection failed. infinite attempts left. common. db.sqlalchemy. session [req-bd52823e- 0de8-475c- ad87-7c0f10818f 58 None] SQL connection failed. infinite attempts left. common. db.sqlalchemy. session [req-bd52823e- 0de8-475c- ad87-7c0f10818f 58 None] SQL connection failed. infinite attempts left. common. db.sqlalchemy. session [req-bd52823e- 0de8-475c- ad87-7c0f10818f 58 None] SQL connection failed. infinite attempts left. common. db.sqlalc. ..
2014-02-05 15:38:44.461 11675 DEBUG heat.openstack.
2014-02-05 15:38:44.477 11675 WARNING heat.openstack.
2014-02-05 15:38:44.479 11675 WARNING heat.openstack.
2014-02-05 15:38:45.481 11675 WARNING heat.openstack.
2014-02-05 15:38:46.481 11675 WARNING heat.openstack.
2014-02-05 15:38:47.482 11675 WARNING heat.openstack.
2014-02-05 15:38:48.483 11675 WARNING heat.openstack.