Services not running that should be: cinder-scheduler

Bug #1980963 reported by Marian Gasparovic
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Cinder Charm
New
Undecided
Unassigned

Bug Description

During SQA test run one cinder unit stayed blocked because "Services not running that should be: cinder-scheduler"

We saw it only once so far. It is wallaby-focal environment.

Artifacts -
https://oil-jenkins.canonical.com/artifacts/4e444742-a7ba-4432-852b-e94f04531009/index.html

Revision history for this message
Bas de Bruijne (basdbruijne) wrote :

I also see `Services not running that should be: cinder-volume` in testrun https://solutions.qa.canonical.com/v2/testruns/8ff4ec95-5bcd-4961-82c3-de13929566e6/

Revision history for this message
Moises Emilio Benzan Mora (moisesbenzan) wrote :

Seen once more on: https://solutions.qa.canonical.com/v2/testruns/ecdab91a-624c-4655-b74e-2ba4b8a69747/

Artifacts: https://oil-jenkins.canonical.com/artifacts/ecdab91a-624c-4655-b74e-2ba4b8a69747/index.html

SKU: fcb-undertest-yoga-jammy-fce_release

cinder/2 blocked idle 5/lxd/3 10.246.165.84 8776/tcp Services not running that should be: cinder-scheduler, cinder-volume

Revision history for this message
Abdullah (motjuste) wrote (last edit ):
Download full text (10.5 KiB)

This occurs again: https://solutions.qa.canonical.com/testruns/4f0927be-1641-489c-b251-8c3351a92fd0/

SKU: fcb-master-yoga-focal

Artifacts: https://oil-jenkins.canonical.com/artifacts/4f0927be-1641-489c-b251-8c3351a92fd0/index.html
Relevant crashdump: https://oil-jenkins.canonical.com/artifacts/4f0927be-1641-489c-b251-8c3351a92fd0/generated/generated/openstack/juju-crashdump-openstack-2023-10-17-16.36.05.tar.gz

The logs in cinder/1 say to look at journalctl logs:

```
2023-10-17 14:46:47 WARNING unit.cinder/1.shared-db-relation-changed logger.go:60 Job for cinder-scheduler.service failed.
2023-10-17 14:46:47 WARNING unit.cinder/1.shared-db-relation-changed logger.go:60 See "systemctl status cinder-scheduler.service" and "journalctl -xe" for details.
```

Last relevant entries in the journal file:

```
Oct 17 15:01:19 juju-280b01-4-lxd-2 systemd[1]: Reloaded The Apache HTTP Server.
Oct 17 15:01:19 juju-280b01-4-lxd-2 systemd[1]: Reloading.
Oct 17 15:01:21 juju-280b01-4-lxd-2 systemd[1]: Reloading.
Oct 17 15:01:22 juju-280b01-4-lxd-2 systemd[1]: Reloading.
Oct 17 15:01:24 juju-280b01-4-lxd-2 systemd[1]: Reloading.
Oct 17 15:01:25 juju-280b01-4-lxd-2 systemd[1]: Started OpenStack Cinder Scheduler.
Oct 17 15:01:25 juju-280b01-4-lxd-2 systemd[1]: Reloading.
Oct 17 15:01:29 juju-280b01-4-lxd-2 cinder-volume[14731]: /usr/lib/python3/dist-packages/cinder/db/sqlalchemy/models.py:152: SAWarning: implicitly coercing SELECT object to scalar subquery; please use the .scalar_subquery() method to produce a scalar subquery.
Oct 17 15:01:29 juju-280b01-4-lxd-2 cinder-volume[14731]: last_heartbeat = column_property(
Oct 17 15:01:29 juju-280b01-4-lxd-2 cinder-volume[14731]: /usr/lib/python3/dist-packages/cinder/db/sqlalchemy/models.py:160: SAWarning: implicitly coercing SELECT object to scalar subquery; please use the .scalar_subquery() method to produce a scalar subquery.
Oct 17 15:01:29 juju-280b01-4-lxd-2 cinder-volume[14731]: num_hosts = column_property(
Oct 17 15:01:29 juju-280b01-4-lxd-2 cinder-volume[14731]: /usr/lib/python3/dist-packages/cinder/db/sqlalchemy/models.py:169: SAWarning: implicitly coercing SELECT object to scalar subquery; please use the .scalar_subquery() method to produce a scalar subquery.
Oct 17 15:01:29 juju-280b01-4-lxd-2 cinder-volume[14731]: num_down_hosts = column_property(
Oct 17 15:01:31 juju-280b01-4-lxd-2 systemd[1]: cinder-volume.service: Main process exited, code=exited, status=1/FAILURE
Oct 17 15:01:31 juju-280b01-4-lxd-2 systemd[1]: cinder-volume.service: Failed with result 'exit-code'.
Oct 17 15:01:31 juju-280b01-4-lxd-2 systemd[1]: cinder-volume.service: Scheduled restart job, restart counter is at 1.
Oct 17 15:01:31 juju-280b01-4-lxd-2 systemd[1]: Stopped OpenStack Cinder Volume.
Oct 17 15:01:31 juju-280b01-4-lxd-2 systemd[1]: Started OpenStack Cinder Volume.
Oct 17 15:01:40 juju-280b01-4-lxd-2 systemd[1]: Condition check resulted in iSCSI initiator daemon (iscsid) being skipped.
Oct 17 15:01:41 juju-280b01-4-lxd-2 cinder-scheduler[15001]: /usr/lib/python3/dist-packages/cinder/db/sqlalchemy/models.py:152: SAWarning: implicitly coercing SELECT object to scalar subquery; please use the .scalar_subquery() method to...

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.