HA: setup-vnc-galera failed also sql db is in lockwait on two openstack nodes
Affects | Status | Importance | Assigned to | Milestone | ||
---|---|---|---|---|---|---|
Juniper Openstack | Status tracked in Trunk | |||||
R2.21.x |
Fix Committed
|
Medium
|
Sanju Abraham | |||
R2.22.x |
Fix Committed
|
Medium
|
Sanju Abraham | |||
R3.0 |
Fix Committed
|
Medium
|
Sanju Abraham | |||
Trunk |
Fix Committed
|
Medium
|
Sanju Abraham |
Bug Description
setup_vnc_galera failed in 3 nodes HA setup.
sql db on first two openstack nodes are in lock state
mysql> show databases;
ERROR 1205 (HY000): Lock wait timeout exceeded; try restarting transaction
mysql>
root@a5s6:~# tail -f /var/log/
160205 17:20:22 [Warning] WSREP: gcs_caused() returned -103 (Software caused connection abort)
160205 17:20:22 [Warning] WSREP: gcs_caused() returned -103 (Software caused connection abort)
160205 17:20:22 [Warning] WSREP: gcs_caused() returned -103 (Software caused connection abort)
setup.log:
========
2016-02-05 16:45:28:800035: [root@10.84.14.7] out: [localhost] local: mysql --defaults-
2016-02-05 16:45:28:807709: [root@10.84.14.7] out: [localhost] local: echo "0 * * * * /opt/contrail/
2016-02-05 16:45:28:815356: [root@10.84.14.7] out: [localhost] local: crontab /tmp/tmp7iRD7p/
2016-02-05 16:45:28:816788: [root@10.84.14.7] out: [localhost] local: rm /tmp/tmp7iRD7p/
2016-02-05 16:45:28:824417: [root@10.84.14.7] out: [localhost] local: ls -l /var/lib/
2016-02-05 16:45:28:824608: [root@10.84.14.7] out: [localhost] local: mysql -h192.168.10.1 -uroot -p732c5a68c8839
2016-02-05 16:45:28:832266: [root@10.84.14.7] out: Waiting for first galera node to create new cluster.
2016-02-05 16:45:40:850753: [root@10.84.14.7] out: Traceback (most recent call last):
2016-02-05 16:45:40:851050: [root@10.84.14.7] out: File "/usr/bin/
2016-02-05 16:45:40:851392: [root@10.84.14.7] out: load_entry_
2016-02-05 16:45:40:851484: [root@10.84.14.7] out: File "/usr/local/
2016-02-05 16:45:40:851571: [root@10.84.14.7] out: galera.setup()
2016-02-05 16:45:40:852033: [root@10.84.14.7] out: File "/usr/local/
2016-02-05 16:45:40:852127: [root@10.84.14.7] out: self.run_services()
2016-02-05 16:45:40:867750: [root@10.84.14.7] out: File "/usr/local/
2016-02-05 16:45:40:868173: [root@10.84.14.7] out: raise RuntimeError(
2016-02-05 16:45:40:868828: [root@10.84.14.7] out: RuntimeError: Unable able to bring up galera in first node, please verify and continue.
2016-02-05 16:45:40:868978: [root@10.84.14.7] out:
2016-02-05 16:45:40:869279:
2016-02-05 16:45:40:870853: Fatal error: sudo() received nonzero return code 1 while executing!
2016-02-05 16:45:40:870853:
2016-02-05 16:45:40:870853: Requested: setup-vnc-galera --self_ip 192.168.10.2 --keystone_ip 192.168.10.201 --galera_ip_list 192.168.10.1 192.168.10.2 192.168.10.3 --internal_vip 192.168.10.201 --openstack_index 2 --zoo_ip_list 192.168.10.1 192.168.10.3 192.168.10.4 --keystone_user keystone --keystone_pass keystone --cmon_user cmon --cmon_pass cmon --monitor_galera True --external_vip 10.84.14.215
2016-02-05 16:45:40:870853: Executed: sudo -S -p 'sudo password:' /bin/bash -l -c "cd /opt/contrail/bin && setup-vnc-galera --self_ip 192.168.10.2 --keystone_ip 192.168.10.201 --galera_ip_list 192.168.10.1 192.168.10.2 192.168.10.3 --internal_vip 192.168.10.201 --openstack_index 2 --zoo_ip_list 192.168.10.1 192.168.10.3 192.168.10.4 --keystone_user keystone --keystone_pass keystone --cmon_user cmon --cmon_pass cmon --monitor_galera True --external_vip 10.84.14.215"
2016-02-05 16:45:40:870853:
2016-02-05 16:45:40:870898: Aborting.
2016-02-05 16:45:40:870898: 2016-02-05 16:45:40:870705: Disconnecting from 10.84.24.68... done.
2016-02-05 16:45:40:985139: Disconnecting from 10.84.14.8... done.
2016-02-05 16:45:40:988674: Disconnecting from 10.84.14.6... done.
2016-02-05 16:45:41:102751: Disconnecting from 10.84.7.18... done.
2016-02-05 16:45:41:166796: Disconnecting from 10.84.24.231... done.
2016-02-05 16:45:41:280853: Disconnecting from 10.84.24.229... done.
2016-02-05 16:45:41:394863: Disconnecting from 10.84.24.230... done.
2016-02-05 16:45:41:508896: Disconnecting from 10.84.14.7... done.
2016-02-05 16:45:41:572869: root@a5s6:
information type: | Proprietary → Public |
tags: | added: blocker |
tags: | removed: blocker |
tags: | added: blocker |
Initial setup all failed due to some other issue but the second time when we ran setup_all sql db's are locked