"live migration fails due to instance record is erased"
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Compute (nova) |
Fix Released
|
Medium
|
Kei Masumoto |
Bug Description
live migration has been done with following procedure.
1. Destination compute node is preparing to be migrated.
2. Source compute node try to migrate instance.
3. Source compute node try to fix db record
(the host where instance running is source -> dest.. etc)
If nova.compute.
_poll_instance_
As the result of that, procedure 3 above raise exception.
Therefore, _poll_instance_
This issue does not always occurs since timing is important.
The exception message is below.
2011-04-06 03:12:19,047 DEBUG nova.rpc [-] MSG_ID is b5f89aa2d22a445
2011-04-06 03:12:30,627 INFO nova.compute.
2011-04-06 03:12:30,627 INFO nova.compute.
libvir: QEMU error : Domain not found: no domain with matching name 'instance-00000005'
2011-04-06 03:12:30,705 INFO nova.compute.
2011-04-06 03:12:30,717 DEBUG nova.utils [-] Attempting to grab semaphore "iptables" for method "apply"... from (pid=10429) inner /opt/ nova/nova/
2011-04-06 03:12:30,718 DEBUG nova.utils [-] Attempting to grab file lock "iptables" for method "apply"... from (pid=10429) inner /opt/ nova/nova/
2011-04-06 03:12:31,190 DEBUG nova.utils [-] Running cmd (subprocess): sudo iptables-save -t filter from (pid=10429) execute /opt/nova/ nova/utils.py:150
2011-04-06 03:12:31,203 DEBUG nova.utils [-] Running cmd (subprocess): sudo iptables-restore from (pid=10429) execute /opt/nova/nova/ut ils.py:150
2011-04-06 03:12:31,218 DEBUG nova.utils [-] Running cmd (subprocess): sudo iptables-save -t nat from (pid=10429) execute /opt/nova/nov a/utils.py:150
2011-04-06 03:12:31,229 DEBUG nova.utils [-] Running cmd (subprocess): sudo iptables-restore from (pid=10429) execute /opt/nova/nova/ut ils.py:150
2011-04-06 03:12:31,282 INFO nova.compute.
2011-04-06 03:12:31,321 ERROR nova [-] in looping call
(nova): TRACE: Traceback (most recent call last):
(nova): TRACE: File "/opt/nova/
(nova): TRACE: self.f(*self.args, **self.kw)
(nova): TRACE: File "/opt/nova/
(nova): TRACE: post_method(ctxt, instance_ref, dest)
(nova): TRACE: File "/opt/nova/
(nova): TRACE: self.recover_
(nova): TRACE: File "/opt/nova/
(nova): TRACE: 'host': host})
(nova): TRACE: File "/opt/nova/
(nova): TRACE: return IMPL.instance_
(nova): TRACE: File "/opt/nova/
(nova): TRACE: return f(*args, **kwargs)
(nova): TRACE: File "/opt/nova/
(nova): TRACE: instance_ref = instance_
(nova): TRACE: File "/opt/nova/
(nova): TRACE: return f(*args, **kwargs)
(nova): TRACE: File "/opt/nova/
(nova): TRACE: instance_id)
(nova): TRACE: InstanceNotFound: Instance 5 not found
Related branches
- Sandy Walsh (community): Approve
- Soren Hansen (community): Needs Fixing
- Brian Waldon (community): Approve
- Devin Carlen (community): Approve
-
Diff: 18 lines (+8/-0)1 file modifiednova/compute/manager.py (+8/-0)
Changed in nova: | |
status: | New → Confirmed |
assignee: | nobody → Kei Masumoto (masumotok) |
status: | Confirmed → In Progress |
Changed in nova: | |
importance: | Undecided → Medium |
Changed in nova: | |
milestone: | none → cactus-rc |
Changed in nova: | |
status: | In Progress → Fix Committed |
Changed in nova: | |
milestone: | cactus-rc → 2011.2 |
status: | Fix Committed → Fix Released |