Unable to create volume from image on Rocky Linux

Bug #2024018 reported by Antony Messerli
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla
Fix Released
High
Maksim Malchuk
Antelope
Fix Released
High
Maksim Malchuk
Wallaby
Fix Released
High
Maksim Malchuk
Xena
Fix Released
High
Maksim Malchuk
Yoga
Fix Released
High
Maksim Malchuk
Zed
Fix Released
High
Maksim Malchuk

Bug Description

What happened:

We are running into an issue where it appears that cinder-volume is unable to create an image to the volume as the cinder-volume container is missing the lsscsi package. It appears that Debian images receive the package but rpm based containers (Rocky) currently do not. We ran into this issue using kolla-ansible on Zed connecting to a PowerMax.

What you expected to happen:

Image should be written to volume so we can boot from volume.

**Environment**: kolla-ansible
* OS (e.g. from /etc/os-release): Rocky 9
* Kernel (e.g. `uname -a`): 5.14.0-162.6.1.el9_1.x86_64
* Docker version if applicable (e.g. `docker version`):
Client: Docker Engine - Community
 Version: 23.0.5
 API version: 1.42
 Go version: go1.19.8
 Git commit: bc4487a
 Built: Wed Apr 26 16:20:15 2023
 OS/Arch: linux/amd64
 Context: default

Server: Docker Engine - Community
 Engine:
  Version: 23.0.5
  API version: 1.42 (minimum version 1.12)
  Go version: go1.19.8
  Git commit: 94d3ad6
  Built: Wed Apr 26 16:17:08 2023
  OS/Arch: linux/amd64
  Experimental: false
 containerd:
  Version: 1.6.20
  GitCommit: 2806fc1057397dbaeefbea0e4e17bddfbd388f38
 runc:
  Version: 1.1.5
  GitCommit: v1.1.5-0-gf19387a
 docker-init:
  Version: 0.19.0
  GitCommit: de40ad0

* Kolla version (e.g. `git head or tag or stable branch` or pip package version if using release): stable/zed

2023-06-15 11:11:57.530 38 ERROR oslo_messaging.rpc.server [None req-08e4550a-ff11-443b-b3aa-34a1d9dfb93c 0547fc71e2f7e322103779705d23ccb78dae02f13f1711abc4e24ff656d61d12 ad37f49affc34077a6fee02020f4ce26 - - - -] Exception during message handling: cinder.exception.ImageCopyFailure: Failed to copy image to volume:
Chained Exception #1
 Traceback (most recent call last):
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/privileged/rootwrap.py", line 174, in execute
     return custom_execute(*cmd, **kwargs)
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
     return putils.execute(on_execute=on_execute,
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/oslo_concurrency/processutils.py", line 395, in execute
     obj = subprocess.Popen(cmd,
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/eventlet/green/subprocess.py", line 58, in __init__
     subprocess_orig.Popen.__init__(self, args, 0, *argss, **kwds)
   File "/usr/lib64/python3.9/subprocess.py", line 951, in __init__
     self._execute_child(args, executable, preexec_fn, close_fds,
   File "/usr/lib64/python3.9/subprocess.py", line 1821, in _execute_child
     raise child_exception_type(errno_num, err_msg, err_filename)
 FileNotFoundError: [Errno 2] No such file or directory: 'lsscsi'

 During handling of the above exception, another exception occurred:

 Traceback (most recent call last):
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/cinder/volume/driver.py", line 512, in _detach_volume
     connector.disconnect_volume(attach_info['conn']['data'],
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/utils.py", line 171, in trace_logging_wrapper
     return f(*args, **kwargs)
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/initiator/connectors/base.py", line 78, in inner
     return f(*args, **kwargs)
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/utils.py", line 386, in change_encrypted
     res = func(**call_args)
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/initiator/connectors/fibre_channel.py", line 374, in disconnect_volume
     dev_info = self._linuxscsi.get_device_info(real_path)
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/initiator/linuxscsi.py", line 122, in get_device_info
     (out, _err) = self._execute('lsscsi')
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/executor.py", line 55, in _execute
     result = self.__execute(*args, **kwargs)
   File "/var/lib/kolla/venv/lib/python3.9/site-packages/os_brick/privileged/rootwrap.py", line 189, in execute
     raise putils.ProcessExecutionError(
 oslo_concurrency.processutils.ProcessExecutionError: [Errno 2] No such file or directory: 'lsscsi'
 Command: lsscsi
 Exit code: -
 Stdout: None
 Stderr: None

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (master)

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/kolla/+/886345

Changed in kolla:
status: New → In Progress
Changed in kolla:
importance: Undecided → High
assignee: nobody → Maksim Malchuk (mmalchuk)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (master)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/886345
Committed: https://opendev.org/openstack/kolla/commit/2e2900e00bb88a38ea51c925d2c6c0cfcd5841bb
Submitter: "Zuul (22348)"
Branch: master

commit 2e2900e00bb88a38ea51c925d2c6c0cfcd5841bb
Author: Maksim Malchuk <email address hidden>
Date: Sun Jun 18 23:30:55 2023 +0300

    Fix cinder-volume: Add forgotten lsscsi rpm package

    Closes-Bug: #2024018
    Change-Id: I7eb97c6bfb65f26b044f26fece09521836ac5a3b
    Signed-off-by: Maksim Malchuk <email address hidden>

Changed in kolla:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/2023.1)

Fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/kolla/+/886383

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/zed)

Fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/kolla/+/886384

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/yoga)

Fix proposed to branch: stable/yoga
Review: https://review.opendev.org/c/openstack/kolla/+/886385

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/xena)

Fix proposed to branch: stable/xena
Review: https://review.opendev.org/c/openstack/kolla/+/886386

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla (stable/wallaby)

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/kolla/+/886387

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/yoga)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/886385
Committed: https://opendev.org/openstack/kolla/commit/f35699e33c8a82855ce412f04b01db8b1a8c8a7a
Submitter: "Zuul (22348)"
Branch: stable/yoga

commit f35699e33c8a82855ce412f04b01db8b1a8c8a7a
Author: Maksim Malchuk <email address hidden>
Date: Sun Jun 18 23:30:55 2023 +0300

    Fix cinder-volume: Add forgotten lsscsi rpm package

    Closes-Bug: #2024018
    Change-Id: I7eb97c6bfb65f26b044f26fece09521836ac5a3b
    Signed-off-by: Maksim Malchuk <email address hidden>
    (cherry picked from commit 2e2900e00bb88a38ea51c925d2c6c0cfcd5841bb)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/886387
Committed: https://opendev.org/openstack/kolla/commit/4a326f91b764bf3b72c14615936e6f433fcae63b
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 4a326f91b764bf3b72c14615936e6f433fcae63b
Author: Maksim Malchuk <email address hidden>
Date: Sun Jun 18 23:30:55 2023 +0300

    Fix cinder-volume: Add forgotten lsscsi rpm package

    Closes-Bug: #2024018
    Change-Id: I7eb97c6bfb65f26b044f26fece09521836ac5a3b
    Signed-off-by: Maksim Malchuk <email address hidden>
    (cherry picked from commit 2e2900e00bb88a38ea51c925d2c6c0cfcd5841bb)
    (cherry picked from commit f35699e33c8a82855ce412f04b01db8b1a8c8a7a)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/xena)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/886386
Committed: https://opendev.org/openstack/kolla/commit/9802f3faebd6a80e3a2dcb30af4fad5e52da84ac
Submitter: "Zuul (22348)"
Branch: stable/xena

commit 9802f3faebd6a80e3a2dcb30af4fad5e52da84ac
Author: Maksim Malchuk <email address hidden>
Date: Sun Jun 18 23:30:55 2023 +0300

    Fix cinder-volume: Add forgotten lsscsi rpm package

    Closes-Bug: #2024018
    Change-Id: I7eb97c6bfb65f26b044f26fece09521836ac5a3b
    Signed-off-by: Maksim Malchuk <email address hidden>
    (cherry picked from commit 2e2900e00bb88a38ea51c925d2c6c0cfcd5841bb)
    (cherry picked from commit f35699e33c8a82855ce412f04b01db8b1a8c8a7a)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/2023.1)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/886383
Committed: https://opendev.org/openstack/kolla/commit/e95ce09cfe58136a42c367dd2b5484823b0a534a
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit e95ce09cfe58136a42c367dd2b5484823b0a534a
Author: Maksim Malchuk <email address hidden>
Date: Sun Jun 18 23:30:55 2023 +0300

    Fix cinder-volume: Add forgotten lsscsi rpm package

    Closes-Bug: #2024018
    Change-Id: I7eb97c6bfb65f26b044f26fece09521836ac5a3b
    Signed-off-by: Maksim Malchuk <email address hidden>
    (cherry picked from commit 2e2900e00bb88a38ea51c925d2c6c0cfcd5841bb)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (stable/zed)

Reviewed: https://review.opendev.org/c/openstack/kolla/+/886384
Committed: https://opendev.org/openstack/kolla/commit/7ae289a5e5e9f07e0a2fe4ce5e3fa0aece27b784
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 7ae289a5e5e9f07e0a2fe4ce5e3fa0aece27b784
Author: Maksim Malchuk <email address hidden>
Date: Sun Jun 18 23:30:55 2023 +0300

    Fix cinder-volume: Add forgotten lsscsi rpm package

    Closes-Bug: #2024018
    Change-Id: I7eb97c6bfb65f26b044f26fece09521836ac5a3b
    Signed-off-by: Maksim Malchuk <email address hidden>
    (cherry picked from commit 2e2900e00bb88a38ea51c925d2c6c0cfcd5841bb)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 16.1.0

This issue was fixed in the openstack/kolla 16.1.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 14.10.0

This issue was fixed in the openstack/kolla 14.10.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 15.2.0

This issue was fixed in the openstack/kolla 15.2.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla wallaby-eol

This issue was fixed in the openstack/kolla wallaby-eol release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla xena-eol

This issue was fixed in the openstack/kolla xena-eol release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.