OpenStack Compute (nova)

Current Nova version does not support computes older than Xena but the minimum compute service level in your system is 56 and the oldest supported service level is 57

Bug #1998671 reported by Satish Patel
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Confirmed
Undecided
Unassigned

Bug Description

I have upgraded wallaby to Xena on Ubuntu 21.04 and nova encounter with following error.

Full track of errors: https://paste.opendev.org/

Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 nova-api-wsgi[44834]: 2022-12-03 16:32:02.852 44834 CRITICAL nova [req-8d50b7db-ba93-46ec-a12a-99e3bb4fc0e2 - - - - -] Unhandled error: nova.exception.TooOldComputeService: Current Nova version does not support computes older than Xena but the minimum compute service level in your system is 56 and the oldest supported service level is 57.
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova Traceback (most recent call last):
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova File "/openstack/venvs/nova-25.2.0/bin/nova-api-wsgi", line 52, in <module>
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova application = init_application()
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/api/openstack/compute/wsgi.py", line 20, in init_application
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova return wsgi_app.init_application(NAME)
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/api/openstack/wsgi_app.py", line 128, in init_application
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova _setup_service(CONF.host, name)
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/api/openstack/wsgi_app.py", line 51, in _setup_service
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova utils.raise_if_old_compute()
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/utils.py", line 1096, in raise_if_old_compute
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova raise exception.TooOldComputeService(
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova nova.exception.TooOldComputeService: Current Nova version does not support computes older than Xena but the minimum compute service level in your system is 56 and the oldest supported service level is 57.
                                                                                     2022-12-03 16:32:02.852 44834 ERROR nova
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 uwsgi[44834]: unable to load app 0 (mountpoint='') (callable not found or import error)
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 uwsgi[44834]: *** no app loaded. GAME OVER ***
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 uwsgi[44829]: SIGINT/SIGTERM received...killing workers...
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 uwsgi[44836]: Traceback (most recent call last):
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 uwsgi[44836]: File "/openstack/venvs/nova-25.2.0/bin/nova-api-wsgi", line 52, in <module>
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 uwsgi[44844]: Traceback (most recent call last):
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 uwsgi[44844]: File "/openstack/venvs/nova-25.2.0/bin/nova-api-wsgi", line 6, in <module>
Dec 03 16:32:02 ostack-phx-api-1-1-nova-api-container-163d6129 nova-api-wsgi[44831]: 2022-12-03 16:32:02.853 44831 CRITICAL nova [-] Unhandled error: KeyboardInterrupt
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova Traceback (most recent call last):
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/bin/nova-api-wsgi", line 52, in <module>
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova application = init_application()
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/api/openstack/compute/wsgi.py", line 20, in init_application
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova return wsgi_app.init_application(NAME)
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/api/openstack/wsgi_app.py", line 125, in init_application
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova init_global_data(conf_files, name)
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/utils.py", line 1123, in wrapper
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova return func(*args, **kwargs)
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/nova/api/openstack/wsgi_app.py", line 111, in init_global_data
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova CONF.log_opt_values(
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/oslo_config/cfg.py", line 2611, in log_opt_values
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova _sanitize(opt, getattr(group_attr, opt_name)))
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/oslo_config/cfg.py", line 3161, in __getattr__
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova return self._conf._get(name, self._group)
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova File "/openstack/venvs/nova-25.2.0/lib/python3.8/site-packages/oslo_config/cfg.py", line 2652, in _get
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova pass
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova KeyboardInterrupt
                                                                                     2022-12-03 16:32:02.853 44831 ERROR nova

Revision history for this message
Satish Patel (satish-txt) wrote :

Solution:

mysql -e "update nova.services set version = 57 where deleted = 0;"

Reference patch but for Victoria:

https://bugs.launchpad.net/nova/+bug/1903545

Revision history for this message
Elod Illes (elod-illes) wrote :

Hi Satish,

To me both the error message and the workaround suggest that the upgrade went from Wallaby to Yoga and not Xena.

Xena would require minimum compute service level 56 (which you have according to the error message), which is Wallaby. But the error message indicates (requires 57, Xena) that the version is Yoga, as these minimum requirements are there.

If this is true, then this is not a bug, as Yoga is N+2 compared to Wallaby. Can you please double check this?

Changed in nova:
status: New → Incomplete
Revision history for this message
Satish Patel (satish-txt) wrote :

Elod,

I have already bump it to 57 by hand using mysql update. But i have one more cloud environment running on Wallaby and i did query and found following version

MariaDB [nova]> select version from nova.services;
+---------+
| version |
 +---------+
| 56 |
| 56 |
| 56 |
| 56 |
| 56 |
| 56 |
 +---------+

Does that indicate 56 is wallaby? I am confused about versioning stuff.

Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for OpenStack Compute (nova) because there has been no activity for 60 days.]

Changed in nova:
status: Incomplete → Expired
Revision history for this message
Diko Parvanov (dparv) wrote :

faced this during focal/ussuri -> jammy/yoga upgrade twice already

Changed in nova:
status: Expired → Confirmed
Revision history for this message
Kamal Bhaskar (kamalb) wrote :
Download full text (3.3 KiB)

Faced this issue when upgraded from focal/wallaby to focal/xena.

Nova API stopped working and was getting response as 500, found below errors in nova-conductor logs:
```
2023-08-14 03:39:07.655 103071 CRITICAL nova [req-c4bcb8f5-8e86-4efc-9097-8bd64f407c73 - - - - -] Unhandled error: nova.exception.TooOldComputeService: Current Nova version does not support computes older than Wallaby but the minimum compute service level in your system is 53 and the oldest supported service level is 54.
2023-08-14 03:39:07.655 103071 ERROR nova Traceback (most recent call last):
2023-08-14 03:39:07.655 103071 ERROR nova File "/usr/bin/nova-conductor", line 10, in <module>
2023-08-14 03:39:07.655 103071 ERROR nova sys.exit(main())
2023-08-14 03:39:07.655 103071 ERROR nova File "/usr/lib/python3/dist-packages/nova/cmd/conductor.py", line 45, in main
2023-08-14 03:39:07.655 103071 ERROR nova server = service.Service.create(binary='nova-conductor',
2023-08-14 03:39:07.655 103071 ERROR nova File "/usr/lib/python3/dist-packages/nova/service.py", line 265, in create
2023-08-14 03:39:07.655 103071 ERROR nova utils.raise_if_old_compute()
2023-08-14 03:39:07.655 103071 ERROR nova File "/usr/lib/python3/dist-packages/nova/utils.py", line 1095, in raise_if_old_compute
2023-08-14 03:39:07.655 103071 ERROR nova raise exception.TooOldComputeService(
2023-08-14 03:39:07.655 103071 ERROR nova nova.exception.TooOldComputeService: Current Nova version does not support computes older than Wallaby but the minimum compute service level in your system is 53 and the oldest supported service level is 54.
2023-08-14 03:39:07.655 103071 ERROR nova
2023-08-14 03:39:11.252 103621 CRITICAL nova [req-d8227fbd-7a20-414f-8d4b-2a6f6354379a - - - - -] Unhandled error: nova.exception.TooOldComputeService: Current Nova version does not support computes older than Wallaby but the minimum compute service level in your system is 53 and the oldest supported service level is 54.
2023-08-14 03:39:11.252 103621 ERROR nova Traceback (most recent call last):
2023-08-14 03:39:11.252 103621 ERROR nova File "/usr/bin/nova-conductor", line 10, in <module>
2023-08-14 03:39:11.252 103621 ERROR nova sys.exit(main())
2023-08-14 03:39:11.252 103621 ERROR nova File "/usr/lib/python3/dist-packages/nova/cmd/conductor.py", line 45, in main
2023-08-14 03:39:11.252 103621 ERROR nova server = service.Service.create(binary='nova-conductor',
2023-08-14 03:39:11.252 103621 ERROR nova File "/usr/lib/python3/dist-packages/nova/service.py", line 265, in create
2023-08-14 03:39:11.252 103621 ERROR nova utils.raise_if_old_compute()
2023-08-14 03:39:11.252 103621 ERROR nova File "/usr/lib/python3/dist-packages/nova/utils.py", line 1095, in raise_if_old_compute
2023-08-14 03:39:11.252 103621 ERROR nova raise exception.TooOldComputeService(
2023-08-14 03:39:11.252 103621 ERROR nova nova.exception.TooOldComputeService: Current Nova version does not support computes older than Wallaby but the minimum compute service level in your system is 53 and the oldest supported service level is 54.
```

Below workaround resolved the problem:

mysql -e "update nova.services set version = 56 wh...

Read more...

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.