Activity log for bug #1947585

Date Who What changed Old value New value Message
2021-10-18 12:37:56 Aurelien Lourot bug added bug
2021-10-18 12:39:30 Aurelien Lourot description This is a spin-off of lp:1927277. On a fresh deployment, some ceilometer-agent units end up blocked due to the ceilometer-agent-compute not running. The ceilometer-agent-compute.log show no problem. `systemctl status ceilometer-agent-compute` shows the service as failed and `journalctl -u ceilometer-agent-compute` shows Oct 18 10:14:25 solqa-lab1-server-11 systemd[1]: ceilometer-agent-compute.service: Start request repeated too quickly. Oct 18 10:14:25 solqa-lab1-server-11 systemd[1]: ceilometer-agent-compute.service: Failed with result 'start-limit-hit'. Oct 18 10:14:25 solqa-lab1-server-11 systemd[1]: Failed to start Ceilometer Agent Compute. I suspect ceilometer-agent-compute was being brought up before the nova-compute service, although ceilometer-agent-compute has a dependency to nova-compute on service level. Or maybe ceilometer-agent-compute was being brought up at a very specific moment when nova-compute was down. This seems to happen often on certain labs and pretty much never on other labs, so this smells like a race condition. This is a spin-off of lp:1927277. On a fresh deployment, some ceilometer-agent units end up blocked due to the ceilometer-agent-compute not running. The ceilometer-agent-compute.log show no problem. `systemctl status ceilometer-agent-compute` shows the service as failed and `journalctl -u ceilometer-agent-compute` shows Oct 18 10:14:25 solqa-lab1-server-11 systemd[1]: ceilometer-agent-compute.service: Start request repeated too quickly. Oct 18 10:14:25 solqa-lab1-server-11 systemd[1]: ceilometer-agent-compute.service: Failed with result 'start-limit-hit'. Oct 18 10:14:25 solqa-lab1-server-11 systemd[1]: Failed to start Ceilometer Agent Compute. I suspect ceilometer-agent-compute was being brought up before the nova-compute service, although ceilometer-agent-compute has a dependency to nova-compute on service level. Or maybe ceilometer-agent-compute was being brought up at a very specific moment when nova-compute was down. This seems to happen often on certain labs and pretty much never on other labs, so this smells like a race condition. Workaround: systemctl restart ceilometer-agent-compute
2021-10-18 12:41:26 Aurelien Lourot attachment added unit-ceilometer-agent-4.log https://bugs.launchpad.net/charm-ceilometer-agent/+bug/1947585/+attachment/5533830/+files/unit-ceilometer-agent-4.log
2021-10-18 12:41:46 Aurelien Lourot attachment added unit-nova-compute-4.log https://bugs.launchpad.net/charm-ceilometer-agent/+bug/1947585/+attachment/5533831/+files/unit-nova-compute-4.log
2021-10-18 12:42:07 Marian Gasparovic tags cdo-qa foundations-engine
2022-01-20 13:15:09 Aurelien Lourot tags cdo-qa foundations-engine aubergine cdo-qa foundations-engine
2022-03-15 15:43:10 Aurelien Lourot bug task added charm-nova-compute
2022-03-15 15:43:22 Aurelien Lourot charm-ceilometer-agent: status New Invalid
2022-03-15 15:43:28 Aurelien Lourot charm-nova-compute: status New In Progress
2022-03-15 15:43:31 Aurelien Lourot charm-nova-compute: importance Undecided High
2022-03-15 15:43:38 Aurelien Lourot charm-nova-compute: assignee Aurelien Lourot (aurelien-lourot)
2022-04-04 23:45:17 OpenStack Infra charm-nova-compute: status In Progress Fix Committed
2022-04-05 08:22:00 Nobuto Murata bug added subscriber Nobuto Murata
2022-04-14 10:03:42 Alex Kavanagh charm-nova-compute: milestone 22.04
2022-05-10 15:30:37 Alex Kavanagh charm-nova-compute: status Fix Committed Fix Released
2022-11-11 19:49:17 Jeffrey Chang bug added subscriber Jeffrey Chang
2023-03-28 07:53:54 Alex Kavanagh charm-nova-compute: status Fix Released In Progress
2023-03-28 07:54:39 Alex Kavanagh charm-nova-compute: assignee Aurelien Lourot (aurelien-lourot) Liam Young (gnuoy)
2023-07-21 13:38:01 Felipe Reyes nominated for series charm-nova-compute/ussuri
2023-07-21 13:38:01 Felipe Reyes bug task added charm-nova-compute/ussuri
2023-07-21 13:38:01 Felipe Reyes nominated for series charm-nova-compute/xena
2023-07-21 13:38:01 Felipe Reyes bug task added charm-nova-compute/xena
2023-07-21 13:38:01 Felipe Reyes nominated for series charm-nova-compute/wallaby
2023-07-21 13:38:01 Felipe Reyes bug task added charm-nova-compute/wallaby
2023-07-21 13:38:01 Felipe Reyes nominated for series charm-nova-compute/train
2023-07-21 13:38:01 Felipe Reyes bug task added charm-nova-compute/train
2023-07-21 13:38:01 Felipe Reyes nominated for series charm-nova-compute/victoria
2023-07-21 13:38:01 Felipe Reyes bug task added charm-nova-compute/victoria
2023-07-21 13:38:09 Felipe Reyes charm-nova-compute: status In Progress Fix Released
2023-07-21 13:38:13 Felipe Reyes charm-nova-compute: assignee Liam Young (gnuoy)
2023-07-21 13:47:04 Felipe Reyes charm-nova-compute: status Fix Released In Progress
2023-08-07 08:17:14 Alex Kavanagh charm-nova-compute: status In Progress Triaged
2023-08-07 21:48:49 OpenStack Infra charm-nova-compute/wallaby: status New In Progress
2023-08-07 21:49:03 OpenStack Infra charm-nova-compute/victoria: status New In Progress
2023-08-07 21:49:16 OpenStack Infra charm-nova-compute/ussuri: status New In Progress
2023-08-07 21:49:46 Felipe Reyes charm-nova-compute/xena: status New Fix Released
2023-08-07 21:50:06 Felipe Reyes charm-nova-compute: status Triaged Fix Released
2023-08-07 21:53:57 OpenStack Infra charm-nova-compute/train: status New In Progress
2023-08-22 14:06:03 OpenStack Infra tags aubergine cdo-qa foundations-engine aubergine cdo-qa foundations-engine in-stable-wallaby
2023-08-22 14:06:12 OpenStack Infra charm-nova-compute/wallaby: status In Progress Fix Committed
2023-08-22 14:08:27 OpenStack Infra tags aubergine cdo-qa foundations-engine in-stable-wallaby aubergine cdo-qa foundations-engine in-stable-victoria in-stable-wallaby
2023-08-22 14:09:06 OpenStack Infra charm-nova-compute/victoria: status In Progress Fix Committed
2023-08-22 14:12:27 OpenStack Infra tags aubergine cdo-qa foundations-engine in-stable-victoria in-stable-wallaby aubergine cdo-qa foundations-engine in-stable-ussuri in-stable-victoria in-stable-wallaby
2023-08-22 14:12:35 OpenStack Infra charm-nova-compute/ussuri: status In Progress Fix Committed
2023-08-22 14:14:51 OpenStack Infra tags aubergine cdo-qa foundations-engine in-stable-ussuri in-stable-victoria in-stable-wallaby aubergine cdo-qa foundations-engine in-stable-train in-stable-ussuri in-stable-victoria in-stable-wallaby
2023-08-22 14:15:00 OpenStack Infra charm-nova-compute/train: status In Progress Fix Committed