Unhandled error - WSREP has not yet prepared node for application use
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
neutron |
Confirmed
|
Medium
|
Unassigned | ||
oslo.db |
Confirmed
|
Undecided
|
Unassigned |
Bug Description
Neutron fails with the following error:
2020-02-14 15:08:21.663 29 CRITICAL neutron [req-b7615e16-
[SQL: SELECT agents.id AS agents_id, agents.agent_type AS agents_agent_type, agents.`binary` AS agents_binary, agents.topic AS agents_topic, agents.host AS agents_host, agents.
FROM agents
WHERE agents.
[parameters: {'admin_
(Background on this error at: http://
We see that mainly in the kolla-ansible upgrade CI - we upgrade the single node Galera instance - and it seems Oslo.db is stuck in claiming the 1047 error on the connection. Once neutron-server container gets restarted - it works properly.
CI logs of neutron-server: https:/
Critical event related to DB:
https:/
After neutron-server restart as part of the upgrade job - everything starts working fine:
https:/
tags: | added: db |
Changed in neutron: | |
importance: | Undecided → Medium |
tags: | added: low-hanging-fruit |
As far as neutron goes, this is part of Ml2Plugin method _start_ rpc_notifiers
https:/ /zuul.opendev. org/t/openstack /build/ bd8c3d336030431 686071cb26f2793 d2/log/ primary/ logs/kolla/ neutron/ neutron- server. txt#260
2020-02-14 14:45:22.591 6 DEBUG neutron. plugins. ml2.plugin [req-b7615e16- e470-4444- 8342-86fca03027 3c - - - - -] neutron. plugins. ml2.plugin. Ml2Plugin method _start_ rpc_notifiers called with arguments () {} wrapper /var/lib/ kolla/venv/ lib/python3. 6/site- packages/ oslo_log/ helpers. py:66
Since this error message is more like "I'm not ready, retry in a bit", rather than "I'm broken, die", we would like it to be treated as such.