kolla

cinder rootwrap not working in newton

Bug #1638585 reported by Piotr Parczewski on 2016-11-02

This bug affects 2 people

Affects		Status	Importance	Assigned to	Milestone
	kolla	Fix Released	Critical	Jeffrey Zhang	kolla ocata-1 "o1"
	Newton	Fix Released	Critical	Jeffrey Zhang	kolla 3.0.2 "newton"

Bug Description

Creating cinder volume from image fails with:

2016-11-02 14:31:36.303 27 WARNING cinder.volume.manager [req-f66daa03-e5fa-42ba-9e66-d4f9326190c2 0459a5f334d746e3bc1218994b3ed857 619b0679d78146a2978f5626222fc267 - default default] Flow 'volume_create_manager' (18f1634b-e0a5-4685-8609-99c72717026b) transitioned into state 'REVERTED' from state 'RUNNING'
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server [req-f66daa03-e5fa-42ba-9e66-d4f9326190c2 0459a5f334d746e3bc1218994b3ed857 619b0679d78146a2978f5626222fc267 - default default] Exception during message handling
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 133, in _process_incoming
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 150, in dispatch
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 121, in _do_dispatch
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 4366, in create_volume
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server allow_reschedule=allow_reschedule, volume=volume)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 634, in create_volume
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server _run_flow()
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/volume/manager.py", line 626, in _run_flow
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server flow_engine.run()
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout):
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/taskflow/types/failure.py", line 336, in reraise_if_any
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server failures[0].reraise()
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/taskflow/types/failure.py", line 343, in reraise
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/taskflow/engines/action_engine/executor.py", line 53, in _execute_task
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server result = task.execute(**arguments)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/manager/create_volume.py", line 842, in execute
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server **volume_spec)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/volume/flows/manager/create_volume.py", line 761, in _create_from_image
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server image_service, context, image_id) as tmp_image:
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server return self.gen.next()
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/image/image_utils.py", line 567, in fetch
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server fetch_verify_image(context, image_service, image_id, tmp)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/image/image_utils.py", line 215, in fetch_verify_image
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server data = qemu_img_info(dest, run_as_root=run_as_root)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/image/image_utils.py", line 78, in qemu_img_info
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server prlimit=QEMU_IMG_LIMITS)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/cinder/utils.py", line 123, in execute
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server return processutils.execute(*cmd, **kwargs)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_concurrency/processutils.py", line 389, in execute
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server cmd=sanitized_cmd)
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server ProcessExecutionError: Unexpected error while running command.
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server Command: /usr/bin/python -m oslo_concurrency.prlimit --as=1073741824 --cpu=2 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /var/lib/cinder/conversion/tmpPY83Qu
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server Exit code: 1
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server Stdout: u''
2016-11-02 14:31:36.304 27 ERROR oslo_messaging.rpc.server Stderr: u'sudo: no tty present and no askpass program specified\n'

Revision history for this message

Jeffrey Zhang (jeffrey4l) wrote on 2016-11-02:

could u provide more info?

kolla-build.conf file
globals.yml file.

seem it is sudoer issue.

Changed in kolla:
importance:	Undecided → Critical
milestone:	none → ocata-1

Revision history for this message

Piotr Parczewski (pparczewski) wrote on 2016-11-03:

kolla-build.conf

[DEFAULT]
base = ubuntu
push = true
registry = 10.180.21.178:4000
install_type = binary
threads = 8
tag = 3.0.0-1
logs_dir = /var/log/kolla-build
[aodh-base]
[barbican-base]
[bifrost-base]
[ceilometer-base]
[cinder-base]
[cloudkitty-base]
[congress-base]
[designate-base]
[glance-base]
[gnocchi-base]
[heat-base]
[horizon]
[horizon-plugin-neutron-lbaas-dashboard]
[ironic-base]
[ironic-inspector]
[keystone-base]
[kuryr-base]
[kuryr-libnetwork]
[magnum-base]
[manila-base]
[mistral-base]
[murano-base]
[neutron-base]
[neutron-lbaas-agent]
[neutron-sfc-agent]
[neutron-vpnaas-agent]
[nova-base]
[nova-novncproxy]
[nova-spicehtml5proxy]
[openstack-base]
[profiles]
[rally]
[sahara-base]
[senlin-base]
[swift-base]
[tempest]
[trove-base]
[watcher-base]
[zaqar]

Revision history for this message

Piotr Parczewski (pparczewski) wrote on 2016-11-03:

globals.yml

---
config_strategy: "COPY_ALWAYS"
kolla_base_distro: "ubuntu"
kolla_install_type: "binary"
openstack_release: "3.0.0-1"
kolla_internal_vip_address: "10.180.21.181"
kolla_internal_fqdn: "dev.kolla.osl01.softlayer.com"
docker_registry: "10.180.21.178:4000"
docker_insecure_registry: "True"
network_interface: "bond1"
neutron_external_interface: "bond0"
openstack_logging_debug: "True"
enable_central_logging: "yes"
enable_ceph: "yes"
enable_ceph_rgw: "yes"
enable_cinder: "yes"
enable_heat: "yes"
enable_horizon: "yes"
enable_magnum: "no"
enable_neutron_lbaas: "yes"
enable_mongodb: "yes"
enable_aodh: "yes"
enable_barbican: "yes"
enable_neutron_dvr: "yes"

Piotr Parczewski (pparczewski) on 2016-11-03

information type:

Public → Private

Piotr Parczewski (pparczewski) on 2016-11-03

information type:

Private → Public

Jeffrey Zhang (jeffrey4l) on 2016-11-03

Changed in kolla:
assignee:	nobody → Jeffrey Zhang (jeffrey4l)

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-11-04: Fix proposed to kolla (master)

Fix proposed to branch: master
Review: https://review.openstack.org/393588

Changed in kolla:
status:	New → In Progress

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-11-04: Fix merged to kolla (master)

Reviewed: https://review.openstack.org/393588
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=cf1dc75f3474f9810fb79d1c327f08134a920b6c
Submitter: Jenkins
Branch: master

commit cf1dc75f3474f9810fb79d1c327f08134a920b6c
Author: Jeffrey Zhang <email address hidden>
Date: Fri Nov 4 01:09:48 2016 +0800

Fix cinder volume permission issue

cinder volume container overwrite the default cinder_sudoers file in
Ubuntu binary install type. Rename it to kolla_cinder_volume_sudoers

Change-Id: I20a362ccb3b4d8e6422f63a1815b62ba47c9d7c1
Closes-Bug: #1638585

Changed in kolla:
status:	In Progress → Fix Released

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-11-04: Fix proposed to kolla (stable/newton)

Fix proposed to branch: stable/newton
Review: https://review.openstack.org/393859

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-11-17: Fix merged to kolla (stable/newton)

Reviewed: https://review.openstack.org/393859
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=6fec3d3801cbd39b989efb503bbaff661e0d7209
Submitter: Jenkins
Branch: stable/newton

commit 6fec3d3801cbd39b989efb503bbaff661e0d7209
Author: Jeffrey Zhang <email address hidden>
Date: Fri Nov 4 01:09:48 2016 +0800

Fix cinder volume permission issue

cinder volume container overwrite the default cinder_sudoers file in
Ubuntu binary install type. Rename it to kolla_cinder_volume_sudoers

    Change-Id: I20a362ccb3b4d8e6422f63a1815b62ba47c9d7c1
    Closes-Bug: #1638585
    (cherry picked from commit cf1dc75f3474f9810fb79d1c327f08134a920b6c)

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-11-17: Fix included in openstack/kolla 4.0.0.0b1

This issue was fixed in the openstack/kolla 4.0.0.0b1 development milestone.

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2017-01-11: Fix included in openstack/kolla 3.0.2

This issue was fixed in the openstack/kolla 3.0.2 release.

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.