Activity log for bug #1624230

Date Who What changed Old value New value Message
2016-09-16 07:08:32 Valentyn Yakovlev bug added bug
2016-09-16 07:08:32 Valentyn Yakovlev attachment added fail_error_delete_add_controller-fuel-snapshot-2016-09-15_14-58-03.tar.gz https://bugs.launchpad.net/bugs/1624230/+attachment/4741812/+files/fail_error_delete_add_controller-fuel-snapshot-2016-09-15_14-58-03.tar.gz
2016-09-16 07:10:47 Valentyn Yakovlev fuel: assignee Fuel QA Team (fuel-qa)
2016-09-16 07:14:16 Alexey Stepanov fuel: assignee Fuel QA Team (fuel-qa) Fuel Sustaining (fuel-sustaining-team)
2016-09-16 13:05:07 Dmitry Klenov fuel: importance Undecided High
2016-09-16 13:05:15 Dmitry Klenov tags controller primary redeploy area-library controller primary redeploy
2016-09-16 13:05:58 Dmitry Klenov fuel: status New Incomplete
2016-09-17 08:15:55 Valentyn Yakovlev attachment added fuel-snapshot-2016-09-16_18-27-46.tar https://bugs.launchpad.net/fuel/+bug/1624230/+attachment/4742515/+files/fuel-snapshot-2016-09-16_18-27-46.tar
2016-09-17 08:16:29 Valentyn Yakovlev fuel: status Incomplete New
2016-09-19 05:57:02 Dmitry Klenov fuel: milestone 9.1
2016-09-19 05:57:05 Dmitry Klenov fuel: status New Confirmed
2016-09-19 10:31:14 Valentyn Yakovlev description Steps to reproduce: 1) deploy cluster: 4 nodes with controller 1 Cinder node 2) Delete primary controller. 3) Add another one controller. 4) Re-deploy cluster. Expected Result: Cluster ready after re-deployment Actual: Redeployment fail with error Steps to reproduce:  1) deploy cluster:    4 nodes with controller    1 Cinder node  2) Delete primary controller.  3) Add another one controller.  4) Re-deploy cluster. Expected Result: Cluster ready after re-deployment Actual: Redeployment fail with error 2016-09-16 16:27:17 ERROR [7f1886631880] (helpers) Extracting of actor_id failed Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/nailgun/task/helpers.py", line 351, in prepare_action_log_kwargs actor_id = action_log.actor_id AttributeError: 'NoneType' object has no attribute 'actor_id' 2016-09-16 15:42:06 ERROR [7f1886631880] (base) Unexpected exception occured Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/base.py", line 297, in handle_errors return func(cls, *args, **kwargs) File "<string>", line 2, in PUT File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/base.py", line 355, in validate return func(cls, *args, **kwargs) File "<string>", line 2, in PUT File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/base.py", line 381, in serialize resp = func(cls, *args, **kwargs) File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/node.py", line 207, in PUT self.collection.single.update_by_agent(node, nd) File "/usr/lib/python2.7/site-packages/nailgun/objects/node.py", line 928, in update_by_agent return cls.update(instance, data) File "/usr/lib/python2.7/site-packages/nailgun/objects/node.py", line 779, in update super(Node, cls).update(instance, data) File "/usr/lib/python2.7/site-packages/nailgun/objects/base.py", line 96, in update db().flush() File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2019, in flush self._flush(objects) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2137, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2101, in _flush flush_context.execute() File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 170, in save_obj mapper, table, update) File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 706, in _emit_update_statements execute(statement, multiparams) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=cause) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) OperationalError: (psycopg2.extensions.TransactionRollbackError) deadlock detected DETAIL: Process 8983 waits for ShareLock on transaction 2768; blocked by process 26677. Process 26677 waits for ShareLock on transaction 2769; blocked by process 8983. HINT: See server log for query details. CONTEXT: SQL statement "SELECT 1 FROM ONLY "public"."clusters" x WHERE "id" OPERATOR(pg_catalog.=) $1 FOR KEY SHARE OF x" [SQL: 'UPDATE nodes SET mac=%(mac)s, agent_checksum=%(agent_checksum)s WHERE nodes.id = %(nodes_id)s'] [parameters: {'agent_checksum': u'deeeec8fce9c1e3ed5c150684b86aa008bebc1ec', 'mac': u'64:86:C0:AD:16:15', 'nodes_id': 9}] [pid: 7727|app: 0|req: 440/790] 10.109.10.11 () {40 vars in 559 bytes} [Fri Sep 16 15:42:05 2016] PUT /api/nodes/agent/ => generated 39 bytes in 1294 msecs (HTTP/1.1 500) 5 headers in 223 bytes (2 switches on core 0) [pid: 7727|app: 0|req: 441/791] 10.109.10.1 () {38 vars in 554 bytes} [Fri Sep 16 15:42:07 2016] GET /api/tasks/1 => generated 276 bytes in 8 msecs (HTTP/1.1 200) 4 headers in 185 bytes (2 switches on core 0)
2016-09-19 14:32:28 Dmitry Pyzhov fuel: assignee Fuel Sustaining (fuel-sustaining-team) Dmitry Guryanov (dguryanov)
2016-09-20 13:13:19 Dmitry Pyzhov fuel: milestone 9.1 9.2
2016-11-23 12:07:05 Dmitry Pyzhov fuel: assignee Dmitry Guryanov (dguryanov) Fuel Sustaining (fuel-sustaining-team)
2016-12-05 09:17:41 Vladimir Kuklin tags area-library controller primary redeploy area-python controller primary redeploy
2016-12-09 16:24:17 Vladimir Kuklin summary fail re-deploys after replacing the main controller Controller redeployment can lead to nailgun DB deadlock
2016-12-12 14:23:00 Dmitry Pyzhov fuel: assignee Fuel Sustaining (fuel-sustaining-team) Georgy Kibardin (gkibardin)
2016-12-14 09:20:09 Georgy Kibardin fuel: status Confirmed Invalid
2016-12-14 09:20:18 Georgy Kibardin fuel: status Invalid In Progress
2016-12-14 14:08:54 Georgy Kibardin fuel: status In Progress Incomplete
2017-01-10 17:45:19 Alexey Shtokolov fuel: milestone 9.2 9.3
2017-01-23 12:49:28 Leontiy Istomin fuel: status Incomplete New
2017-01-24 12:56:41 Alexander Kislitsky fuel: status New Confirmed
2017-01-25 11:45:19 Georgy Kibardin fuel: status Confirmed In Progress
2017-01-25 13:15:45 Georgy Kibardin attachment added 1 https://bugs.launchpad.net/fuel/+bug/1624230/+attachment/4808941/+files/1
2017-01-25 13:16:20 Georgy Kibardin attachment added 2 https://bugs.launchpad.net/fuel/+bug/1624230/+attachment/4808942/+files/2
2017-01-25 20:44:56 Mikhail Chernik bug added subscriber Mikhail Chernik
2017-01-26 10:13:49 Sergey Philippov bug added subscriber Sergey Philippov
2017-02-09 13:57:45 OpenStack Infra tags area-python controller primary redeploy area-python controller in-stable-newton primary redeploy
2017-02-16 14:47:31 Denis Meltsaykin fuel: milestone 9.x-updates 9.2-mu-1
2017-02-16 14:52:06 OpenStack Infra tags area-python controller in-stable-newton primary redeploy area-python controller in-stable-mitaka in-stable-newton primary redeploy
2017-02-16 14:53:38 Georgy Kibardin nominated for series fuel/newton
2017-02-16 14:53:38 Georgy Kibardin bug task added fuel/newton
2017-02-16 14:53:38 Georgy Kibardin nominated for series fuel/ocata
2017-02-16 14:54:17 Georgy Kibardin fuel/newton: status New Fix Committed
2017-02-16 14:54:21 Georgy Kibardin fuel/newton: importance Undecided High
2017-02-16 14:54:24 Georgy Kibardin fuel/newton: assignee Georgy Kibardin (gkibardin)
2017-02-16 14:54:32 Georgy Kibardin nominated for series fuel/future
2017-02-16 14:54:32 Georgy Kibardin bug task added fuel/future
2017-02-16 14:55:02 Georgy Kibardin fuel/newton: milestone 10.1
2017-02-16 14:55:18 Georgy Kibardin fuel/future: milestone 11.0
2017-02-16 14:55:23 Georgy Kibardin fuel/future: assignee Georgy Kibardin (gkibardin)
2017-02-16 14:55:28 Georgy Kibardin fuel/future: status New Fix Committed
2017-02-16 14:55:31 Georgy Kibardin fuel/future: importance Undecided High
2017-02-17 12:39:40 Georgy Kibardin fuel: status In Progress Fix Committed
2017-03-31 10:32:02 Ekaterina Shutova fuel: status Fix Committed Fix Released
2017-04-06 20:00:56 Georgy Kibardin fuel/newton: status Fix Committed Fix Released