vm migration problem

Bug #1604668 reported by Bartłomiej Daca
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Invalid
Critical
Unassigned

Bug Description

When trying to migrate the VM the error occurs:

Traceback (most recent call last): File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply incoming.message))
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch return self._do_dispatch(endpoint, method, ctxt, args)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch result = func(ctxt, **new_args)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/exception.py", line 110, in wrapped payload)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ self.force_reraise()
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise six.reraise(self.type_, self.value, self.tb)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/exception.py", line 89, in wrapped return f(self, context, *args, **kw)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 359, in decorated_function LOG.warning(msg, e, instance=instance)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ self.force_reraise()
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise six.reraise(self.type_, self.value, self.tb)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 328, in decorated_function return function(self, context, *args, **kwargs)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 409, in decorated_function return function(self, context, *args, **kwargs)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 316, in decorated_function migration.instance_uuid, exc_info=True)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ self.force_reraise()
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise six.reraise(self.type_, self.value, self.tb)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 293, in decorated_function return function(self, context, *args, **kwargs)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 387, in decorated_function kwargs['instance'], e, sys.exc_info())
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__ self.force_reraise()
File "/var/lib/kolla/venv/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise six.reraise(self.type_, self.value, self.tb)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 375, in decorated_function return function(self, context, *args, **kwargs)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 3924, in resize_instance self.instance_events.clear_events_for_instance(instance)
File "/usr/lib64/python2.7/contextlib.py", line 35, in __exit__ self.gen.throw(type, value, traceback)
File "/var/lib/kolla/venv/lib/python2.7/site-packages/nova/compute/manager.py", line 6608, in _error_out_instance_on_exception raise error.inner_exception
ResizeError: Resize error: not able to execute ssh command: Unexpected error while running command.
Command: ssh 10.24.12.14 mkdir -p /var/lib/nova/instances/640a1b8d-7751-47bd-8f48-1ee7e4e532b0
Exit code: 255
Stdout: u''
Stderr: u"Warning: Permanently added '[10.24.12.14]:8022' (ECDSA) to the list of known hosts.\r\nSystem is booting up. See pam_nologin(8)\nConnection closed by 10.24.12.14\r\n"

The problem occurs when the docker image centos:latest is used. It seems that systemd or anything else what is responsible for this does not remove /run/nologin file. When this file exists the pam_nologin module denies access.

I have tested all other centos 7 images, centos 6:latest and ubuntu:latest and this problem does NOT occur.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on kolla (master)

Change abandoned by Bartłomiej Daca (<email address hidden>) on branch: master
Review: https://review.openstack.org/344574
Reason: centos image is fixed now

Changed in kolla:
status: New → Invalid
Changed in kolla:
milestone: none → newton-3
importance: Undecided → Critical
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.