post-series-upgrade hook error when series-upgrading principle nova-compute
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Ceilometer Agent Charm |
Fix Released
|
High
|
Aurelien Lourot |
Bug Description
Related to lp:1927277. Can be reproduced by running the series-upgrade tests. [1] Here is what happens:
1. nova-compute (principal) and ceilometer-agent (subordinate) are running on the same bionic machine.
2. A series upgrade of that machine is started. This runs the pre-series-upgrade hooks of both charms, effectively stopping both the nova-compute and the ceilometer-
3. `juju upgrade-series <machine-number> complete` is run. This runs ceilometer-agent's post-series-upgrade hook, attempting to start the ceilometer-
Zaza logs:
----------
2021-11-30 18:41:53 [INFO] About to upgrade leader of nova-compute: 15
2021-11-30 18:41:53 [INFO] About to series-upgrade (15)
2021-11-30 18:41:53 [INFO] About to call '['juju', 'run', '--machine=15', '--', 'echo \'DPkg::options { "--force-confdef"; "--force-confnew"; }\' | sudo tee /etc/apt/
...
2021-11-30 18:42:02 [INFO] About to call '['juju', 'run', '--machine=15', '--', 'yes | sudo DEBIAN_
...
2021-11-30 18:42:16 [INFO] About to call '['juju', 'run', '--machine=15', '--timeout=120m', '--', 'yes | sudo DEBIAN_
...
2021-11-30 19:00:33 [INFO] About to call '['juju', 'upgrade-series', '-m', 'zaza-97c5ac52f
----------
ceilometer-agent unit log:
----------
2021-11-30 19:01:00 WARNING post-series-upgrade Removed /etc/systemd/
2021-11-30 19:01:01 WARNING post-series-upgrade Synchronizing state of memcached.service with SysV service script with /lib/systemd/
2021-11-30 19:01:01 WARNING post-series-upgrade Executing: /lib/systemd/
2021-11-30 19:01:02 WARNING post-series-upgrade Created symlink /etc/systemd/
2021-11-30 19:01:02 DEBUG post-series-upgrade inactive
2021-11-30 19:01:02 WARNING post-series-upgrade Removed /etc/systemd/
2021-11-30 19:01:03 WARNING post-series-upgrade Synchronizing state of ceilometer-
2021-11-30 19:01:03 WARNING post-series-upgrade Executing: /lib/systemd/
2021-11-30 19:01:04 WARNING post-series-upgrade Created symlink /etc/systemd/
2021-11-30 19:01:04 DEBUG post-series-upgrade inactive
2021-11-30 19:01:04 WARNING post-series-upgrade Failed to start ceilometer-
2021-11-30 19:01:04 DEBUG post-series-upgrade active
2021-11-30 19:01:04 DEBUG post-series-upgrade inactive
2021-11-30 19:01:04 DEBUG jujuc server.go:211 running hook tool "status-set" for ceilometer-
2021-11-30 19:01:04 WARNING post-series-upgrade Traceback (most recent call last):
2021-11-30 19:01:04 WARNING post-series-upgrade File "/var/lib/
2021-11-30 19:01:04 WARNING post-series-upgrade hooks.execute(
2021-11-30 19:01:04 WARNING post-series-upgrade File "/var/lib/
2021-11-30 19:01:04 WARNING post-series-upgrade self._hooks[
2021-11-30 19:01:04 WARNING post-series-upgrade File "/var/lib/
2021-11-30 19:01:04 WARNING post-series-upgrade series_
2021-11-30 19:01:04 WARNING post-series-upgrade File "/var/lib/
2021-11-30 19:01:04 WARNING post-series-upgrade resume_
2021-11-30 19:01:04 WARNING post-series-upgrade File "/var/lib/
2021-11-30 19:01:04 WARNING post-series-upgrade _pause_
2021-11-30 19:01:04 WARNING post-series-upgrade File "/var/lib/
2021-11-30 19:01:04 WARNING post-series-upgrade f(assess_
2021-11-30 19:01:04 WARNING post-series-upgrade File "/var/lib/
2021-11-30 19:01:04 WARNING post-series-upgrade raise Exception("Couldn't resume: {}".format("; ".join(messages)))
2021-11-30 19:01:04 WARNING post-series-upgrade Exception: Couldn't resume: ceilometer-
----------
The pause/resume logic should be entirely removed from ceilometer-agent. Since lp:1927277 the principal charm nova-compute is responsible for pausing/resuming the services of its subordinates.
[1]: https:/
description: | updated |
tags: | added: aubergine |
Changed in charm-ceilometer-agent: | |
milestone: | none → 22.04 |
Changed in charm-ceilometer-agent: | |
status: | Fix Committed → Fix Released |
Fix proposed to branch: master /review. opendev. org/c/openstack /charm- ceilometer- agent/+ /820001
Review: https:/