kolla_toolbox fails to deploy after switching from kolla-ansible 16.1.0 to master tag

Bug #2038914 reported by Marcel Hauptmann
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
New
Undecided
Unassigned

Bug Description

**Bug Report**

We have successfully deployed openstack with kolla-ansible version 16.1.0. Unfortunately, we have problems with the opensearch container in this version - it does not start and always crashes.

Therefore we would like to deploy OpenStack with kolla-ansible master. However, in this version we have the problem that kolla-toolbox is not found during the deployment. The deployment fails on all nodes:

----------------------------

Error in gitlab pipeline:

fatal: [10.21.20.2]: FAILED! => {"Command": "dumb-init --single-child -- kolla_start", "Created": 1696926350, "HostConfig": {"NetworkMode": "host"}, "Id": "395e3ee92d5146ae6e0f3a2dab16194f7499f898d7e00fb7a2847ee72d44e2b7", "Image": "quay.io/openstack.kolla/kolla-toolbox:2023.1-rocky-9", "ImageID": "sha256:5b8102090b7995252a753d2836c7b10545e40939572cfb8e7ab82c28d901e8f3", "Labels": {"build-date": "20230920", "io.buildah.version": "1.30.0", "kolla_version": "16.1.1", "maintainer": "Kolla Project (https://launchpad.net/kolla)", "name": "kolla-toolbox"}, "Mounts": [{"Destination": "/dev", "Mode": "rw", "Propagation": "rprivate", "RW": true, "Source": "/dev", "Type": "bind"}, {"Destination": "/etc/localtime", "Mode": "ro", "Propagation": "rprivate", "RW": false, "Source": "/etc/localtime", "Type": "bind"}, {"Destination": "/run", "Mode": "shared", "Propagation": "shared", "RW": true, "Source": "/run", "Type": "bind"}, {"Destination": "/var/lib/kolla/config_files", "Mode": "ro", "Propagation": "rprivate", "RW": false, "Source": "/etc/kolla/kolla-toolbox", "Type": "bind"}, {"Destination": "/var/log/kolla", "Driver": "local", "Mode": "rw", "Name": "kolla_logs", "Propagation": "", "RW": true, "Source": "/var/lib/docker/volumes/kolla_logs/_data", "Type": "volume"}], "Names": ["/kolla_toolbox"], "NetworkSettings": {"Networks": {"host": {"Aliases": null, "DriverOpts": null, "EndpointID": "", "Gateway": "", "GlobalIPv6Address": "", "GlobalIPv6PrefixLen": 0, "IPAMConfig": null, "IPAddress": "", "IPPrefixLen": 0, "IPv6Gateway": "", "Links": null, "MacAddress": "", "NetworkID": "8a180824a28e73a21f8806bebeb90a64aedde3789fbe1365e8fad3a9ac9e8bd2"}}}, "Ports": [], "State": "exited", "Status": "Exited (127) 23 seconds ago", "changed": true, "msg": "Container timed out"}

----------------------------

docker logs kolla_toolbox

+ sudo -E kolla_set_configs
INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json
INFO:__main__:Validating config file
INFO:__main__:Kolla config strategy set to: COPY_ALWAYS
INFO:__main__:Copying service configuration files
INFO:__main__:Deleting /var/lib/rabbitmq/.erlang.cookie
INFO:__main__:Copying /var/lib/kolla/config_files/rabbitmq-erlang.cookie to /var/lib/rabbitmq/.erlang.cookie
INFO:__main__:Setting permission for /var/lib/rabbitmq/.erlang.cookie
INFO:__main__:Deleting /etc/rabbitmq/rabbitmq-env.conf
INFO:__main__:Copying /var/lib/kolla/config_files/rabbitmq-env.conf to /etc/rabbitmq/rabbitmq-env.conf
INFO:__main__:Setting permission for /etc/rabbitmq/rabbitmq-env.conf
INFO:__main__:Deleting /etc/rabbitmq/erl_inetrc
INFO:__main__:Copying /var/lib/kolla/config_files/erl_inetrc to /etc/rabbitmq/erl_inetrc
INFO:__main__:Setting permission for /etc/rabbitmq/erl_inetrc
INFO:__main__:Writing out command to execute
INFO:__main__:Setting permission for /var/log/kolla/ansible.log
++ cat /run_command
+ CMD=kolla_toolbox
+ ARGS=
+ sudo kolla_copy_cacerts
+ [[ ! -n '' ]]
+ . kolla_extend_start
++ [[ ! -f /var/log/kolla/ansible.log ]]
+++ stat -c %U:%G /var/log/kolla/ansible.log
++ [[ ansible:kolla != \a\n\s\i\b\l\e\:\k\o\l\l\a ]]
+++ stat -c %a /var/log/kolla/ansible.log
++ [[ 664 != \6\6\4 ]]
+ echo 'Running command: '\''kolla_toolbox'\'''
+ exec kolla_toolbox
Running command: 'kolla_toolbox'
/usr/local/bin/kolla_start: line 24: exec: kolla_toolbox: not found

----------------------------

How can we fix kolla_toolbox in kolla-ansible master?

Thanks in advance!

**Environment**
- OS: Rocky Linux 9.2
- OpenStack Release: 2023.1
- Kernel:5.14.0-284.25.1.el9_2.x86_64
- Docker version: 24.0.6
- Kolla-ansible version: switched from 16.1.0 to master
- Are you using official images from Docker Hub or self built -> Official images

summary: - kolla_toolbox fails to deploy after switching from kolla-ansible 16.0.1
+ kolla_toolbox fails to deploy after switching from kolla-ansible 16.1.0
to master tag
description: updated
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.