Static Ceph mon IP addresses in connection_info can prevent VM startup
Bug #1452641 reported by
Arne Wiebalck
This bug affects 26 people
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Confirmed
|
Medium
|
Unassigned | ||
nova (Ubuntu) |
Triaged
|
Medium
|
Unassigned |
Bug Description
The Cinder rbd driver extracts the IP addresses of the Ceph mon servers from the Ceph mon map when the instance/volume connection is established. This info is then stored in nova's block-device-
Changing the Ceph mon servers' IP adresses will prevent the instance from booting as the stale connection info will enter the instance's XML. One idea to fix this would be to use the information from ceph.conf, which should be an alias or a loadblancer, directly.
tags: | added: ceph |
Changed in cinder: | |
assignee: | nobody → Bin Zhou (binzhou) |
tags: | added: drivers |
Changed in cinder: | |
assignee: | nobody → Jon Bernard (jbernard) |
tags: | added: canonical-bootstack |
Changed in nova: | |
assignee: | nobody → Corey Bryant (corey.bryant) |
Changed in nova (Ubuntu): | |
assignee: | nobody → Corey Bryant (corey.bryant) |
Changed in nova (Ubuntu): | |
status: | New → In Progress |
importance: | Undecided → Medium |
Changed in nova: | |
assignee: | Corey Bryant (corey.bryant) → Seyeong Kim (xtrusia) |
Changed in nova: | |
assignee: | Seyeong Kim (xtrusia) → Lee Yarwood (lyarwood) |
Changed in nova: | |
assignee: | Lee Yarwood (lyarwood) → Seyeong Kim (xtrusia) |
Changed in nova: | |
assignee: | Seyeong Kim (xtrusia) → Lee Yarwood (lyarwood) |
Changed in nova: | |
assignee: | Lee Yarwood (lyarwood) → Seyeong Kim (xtrusia) |
Changed in nova (Ubuntu): | |
assignee: | Corey Bryant (corey.bryant) → nobody |
Changed in nova (Ubuntu): | |
assignee: | nobody → Seyeong Kim (xtrusia) |
Changed in nova: | |
assignee: | Seyeong Kim (xtrusia) → nobody |
Changed in nova (Ubuntu): | |
assignee: | Seyeong Kim (xtrusia) → nobody |
Changed in nova (Ubuntu): | |
status: | In Progress → Triaged |
information type: | Public → Public Security |
To post a comment you must log in.
Nova stores the volume connection info in its db, so updating that
would be a workaround to allow restart/migration of vms to work.
Otherwise running vms shouldn't be affected, since they'll notice any
new or deleted monitors through their existing connection to the
monitor cluster.
Perhaps the most general way to fix this would be for cinder to return
any monitor hosts listed in ceph.conf (as they are listed, so they may
be hostnames or ips) in addition to the ips from the current monmap
(the current behavior).
That way an out of date ceph.conf is less likely to cause problems,
and multiple clusters could still be used with the same nova node.