Ceph RADOS Gateway Charm

Initialization of realm, zonegroup, zones etc. may also be necessary in a single-site scenario

Bug #1941715 reported by Frode Nordahl on 2021-08-26

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Ceph RADOS Gateway Charm	New	Undecided	Unassigned

Bug Description

In a focal-ussuri deploy using -next charms with a single ceph-radosgw unit I got into a situation where neither realm, zonegroup or any zones existed.

The charm currently assumes that realm and zonegroup will always exist in a single-site scenario and as such it was not able to recover.

It may be that we need to move the logic in the master-relation-joined hook into the regular mon-relation-changed hook so that the charm can deal with the cluster regardless of its state.

Revision history for this message

Frode Nordahl (fnordahl) wrote on 2021-08-26:

Download full text (80.3 KiB)

Unit log:
2021-08-26 05:47:26 INFO juju unit_agent.go:253 Starting unit workers for "ceph-radosgw/0"
2021-08-26 05:47:26 INFO juju.worker.apicaller connect.go:158 [bb06d3] "unit-ceph-radosgw-0" successfully connected to "10.246.115.255:17070"
2021-08-26 05:47:26 INFO juju.worker.apicaller connect.go:255 [bb06d3] password changed for "unit-ceph-radosgw-0"
2021-08-26 05:47:27 INFO juju.worker.apicaller connect.go:158 [bb06d3] "unit-ceph-radosgw-0" successfully connected to "10.246.115.255:17070"
2021-08-26 05:47:27 INFO juju.worker.migrationminion worker.go:140 migration phase is now: NONE
2021-08-26 05:47:27 INFO juju.worker.logger logger.go:120 logger worker started
2021-08-26 05:47:27 INFO juju.worker.upgrader upgrader.go:219 no waiter, upgrader is done
2021-08-26 05:47:27 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing)
2021-08-26 05:47:27 INFO juju.worker.uniter uniter.go:328 unit "ceph-radosgw/0" started
2021-08-26 05:47:27 INFO juju.worker.uniter uniter.go:629 resuming charm install
2021-08-26 05:47:27 INFO juju.worker.uniter.charm bundles.go:79 downloading cs:~openstack-charmers-next/ceph-radosgw-407 from API server
2021-08-26 05:47:27 INFO juju.worker.uniter uniter.go:346 hooks are retried true
2021-08-26 05:47:27 INFO juju.worker.uniter.storage resolver.go:127 initial storage attachments ready
2021-08-26 05:47:27 INFO juju.worker.uniter resolver.go:148 found queued "install" hook
2021-08-26 05:47:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 Installing python3-psutil with options: ['--option=Dpkg::Options::=--force-confold']
2021-08-26 05:47:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:47:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:47:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 Installing Apache
2021-08-26 05:47:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 Installing ['apache2'] with options: ['--option=Dpkg::Options::=--force-confold']
2021-08-26 05:47:54 INFO unit.ceph-radosgw/0.juju-log server.go:314 Disabling unused Apache sites
2021-08-26 05:47:54 INFO unit.ceph-radosgw/0.juju-log server.go:314 Restarting Apache
2021-08-26 05:47:54 WARNING unit.ceph-radosgw/0.install logger.go:60 Job for apache2.service failed because the control process exited with error code.
2021-08-26 05:47:54 WARNING unit.ceph-radosgw/0.install logger.go:60 See "systemctl status apache2.service" and "journalctl -xe" for details.
2021-08-26 05:47:54 INFO unit.ceph-radosgw/0.juju-log server.go:314 Installing ['haproxy', 'radosgw', 'apache2'] with options: ['--option=Dpkg::Options::=--force-confold']
2021-08-26 05:48:12 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package libapache2-mod-fastcgi has no installation candidate.
2021-08-26 05:48:12 WARNING unit.ceph-radosgw/0.install logger.go:60 radosgw.service is not a native service, redirecting to systemd-sysv-install.
2021-08-26 05:48:12 WARNING unit.ceph-radosgw/0.install logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable radosgw
2021-08-26 05:48:13 WARNING unit.ceph-radosgw/0.install logger.go:60 Created symlink /etc/systemd/system/radosgw.service → /dev/null.
2021-08-26 05:48:13 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon relation is missing and must be related for functionality. 
2021-08-26 05:48:14 INFO juju.worker.uniter.operation runhook.go:145 ran "install" hook (via explicit, bespoke hook script)
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:159 joining relation "ceph-radosgw:cluster"
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:195 joined relation "ceph-radosgw:cluster"
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:159 joining relation "ceph-radosgw:mon ceph-mon:radosgw"
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:195 joined relation "ceph-radosgw:mon ceph-mon:radosgw"
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:159 joining relation "ceph-radosgw:identity-service keystone:identity-service"
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:195 joined relation "ceph-radosgw:identity-service keystone:identity-service"
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:159 joining relation "ceph-radosgw:certificates vault:certificates"
2021-08-26 05:48:14 INFO juju.worker.uniter.relation statetracker.go:195 joined relation "ceph-radosgw:certificates vault:certificates"
2021-08-26 05:48:14 INFO juju.worker.uniter.operation runhook.go:148 skipped "certificates-relation-created" hook (missing)
2021-08-26 05:48:14 INFO juju.worker.uniter.operation runhook.go:148 skipped "identity-service-relation-created" hook (missing)
2021-08-26 05:48:15 INFO juju.worker.uniter.operation runhook.go:148 skipped "cluster-relation-created" hook (missing)
2021-08-26 05:48:15 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-created" hook (missing)
2021-08-26 05:48:15 INFO juju.worker.uniter resolver.go:148 found queued "leader-elected" hook
2021-08-26 05:48:15 INFO juju.worker.uniter.operation runhook.go:148 skipped "leader-elected" hook (missing)
2021-08-26 05:48:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:48:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:48:17 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package libapache2-mod-fastcgi has no installation candidate.
2021-08-26 05:48:17 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:48:17 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:17 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:18 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:18 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:18 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:19 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:19 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:19 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:19 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:19 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:20 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:20 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:20 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:20 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:21 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:21 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:21 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:22 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:48:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 05:48:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 05:48:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 05:48:22 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:23 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:23 INFO unit.ceph-radosgw/0.juju-log server.go:314 Loaded template from templates/ceph.conf
2021-08-26 05:48:23 INFO unit.ceph-radosgw/0.juju-log server.go:314 Rendering from template: /etc/ceph/ceph.conf
2021-08-26 05:48:23 INFO unit.ceph-radosgw/0.juju-log server.go:314 Wrote template /etc/ceph/ceph.conf.
2021-08-26 05:48:23 WARNING unit.ceph-radosgw/0.config-changed logger.go:60 Failed to restart radosgw.service: Unit radosgw.service is masked.
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 05:48:24 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:24 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Loaded template from templates/ceph.conf
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Rendering from template: /etc/ceph/ceph.conf
2021-08-26 05:48:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Wrote template /etc/ceph/ceph.conf.
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 05:48:25 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:25 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Loaded template from templates/ceph.conf
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Rendering from template: /etc/ceph/ceph.conf
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Wrote template /etc/ceph/ceph.conf.
2021-08-26 05:48:25 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:26 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:26 WARNING unit.ceph-radosgw/0.config-changed logger.go:60 ERROR: Site openstack_https_frontend does not exist!
2021-08-26 05:48:26 WARNING unit.ceph-radosgw/0.config-changed logger.go:60 apache2.service is not active, cannot reload.
2021-08-26 05:48:26 WARNING unit.ceph-radosgw/0.config-changed logger.go:60 Job for apache2.service failed because the control process exited with error code.
2021-08-26 05:48:26 WARNING unit.ceph-radosgw/0.config-changed logger.go:60 See "systemctl status apache2.service" and "journalctl -xe" for details.
2021-08-26 05:48:26 INFO unit.ceph-radosgw/0.juju-log server.go:314 Installing python-dbus with options: ['--option=Dpkg::Options::=--force-confold']
2021-08-26 05:48:32 INFO unit.ceph-radosgw/0.juju-log server.go:314 Check command not found: check_systemd.py
2021-08-26 05:48:32 INFO unit.ceph-radosgw/0.juju-log server.go:314 Check command not found: check_systemd.py
2021-08-26 05:48:32 INFO unit.ceph-radosgw/0.juju-log server.go:314 Nagios user not set up, nrpe checks not updated
2021-08-26 05:48:32 WARNING unit.ceph-radosgw/0.config-changed logger.go:60 Failed to restart radosgw.service: Unit radosgw.service is masked.
2021-08-26 05:48:32 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:32 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: mon_hosts fsid
2021-08-26 05:48:33 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:33 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: mon_hosts, fsid. 
2021-08-26 05:48:33 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity relations's interface, identity-service, is related but has no units in the relation.
2021-08-26 05:48:33 INFO juju.worker.uniter.operation runhook.go:145 ran "config-changed" hook (via explicit, bespoke hook script)
2021-08-26 05:48:34 INFO juju.worker.uniter resolver.go:148 found queued "start" hook
2021-08-26 05:48:34 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:48:34 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:48:34 INFO unit.ceph-radosgw/0.juju-log server.go:314 Unknown hook start - skipping.
2021-08-26 05:48:34 INFO juju.worker.uniter.operation runhook.go:145 ran "start" hook (via explicit, bespoke hook script)
2021-08-26 05:48:39 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-joined" hook (missing)
2021-08-26 05:48:40 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:48:40 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:48:41 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:48:41 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:41 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 05:48:42 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:48:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: identity relations's interface, identity-service, is related but has no units in the relation.
2021-08-26 05:48:42 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 05:48:58 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:48:58 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:48:58 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:48:58 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:58 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:48:59 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:59 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:48:59 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:48:59 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:48:59 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:48:59 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:00 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:00 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:00 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:00 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:00 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:00 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:01 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:01 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:01 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:01 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:02 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:02 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:02 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:02 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:02 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:02 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:03 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:03 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:03 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:03 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:03 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:49:03 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:49:04 INFO juju.worker.uniter.operation runhook.go:145 ran "identity-service-relation-joined" hook (via explicit, bespoke hook script)
2021-08-26 05:49:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:49:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:49:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:49:05 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:06 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:06 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:06 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:06 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:07 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:07 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:09 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:09 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:49:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 05:49:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 05:49:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 05:49:09 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:10 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Loaded template from templates/ceph.conf
2021-08-26 05:49:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Rendering from template: /etc/ceph/ceph.conf
2021-08-26 05:49:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Wrote template /etc/ceph/ceph.conf.
2021-08-26 05:49:10 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:49:11 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:11 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:11 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:49:11 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:49:11 INFO juju.worker.uniter.operation runhook.go:145 ran "identity-service-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 05:49:41 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-joined" hook (missing)
2021-08-26 05:49:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:49:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:49:43 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:49:43 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:49:43 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 05:49:43 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:49:43 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:49:43 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:49:43 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:49:44 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 05:52:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:52:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:52:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 05:52:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:52:04 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:52:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 05:52:05 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:52:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:52:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:52:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:52:06 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 05:52:06 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-joined" hook (missing)
2021-08-26 05:52:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:52:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:52:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:52:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:52:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 05:52:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:52:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:52:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:52:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:52:09 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 05:53:02 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:53:02 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:53:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:53:04 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:53:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: fsid
2021-08-26 05:53:05 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:53:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:53:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:53:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:53:05 INFO juju.worker.uniter.operation runhook.go:145 ran "certificates-relation-joined" hook (via explicit, bespoke hook script)
2021-08-26 05:53:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:53:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:53:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Making dir /etc/apache2/ssl/ceph-radosgw root:root 555
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 05:53:07 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: fsid
2021-08-26 05:53:07 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Loaded template from templates/ceph.conf
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Rendering from template: /etc/ceph/ceph.conf
2021-08-26 05:53:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Wrote template /etc/ceph/ceph.conf.
2021-08-26 05:53:07 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:53:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: fsid
2021-08-26 05:53:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:53:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:53:08 WARNING unit.ceph-radosgw/0.certificates-relation-changed logger.go:60 ERROR: Site openstack_https_frontend does not exist!
2021-08-26 05:53:08 WARNING unit.ceph-radosgw/0.certificates-relation-changed logger.go:60 apache2.service is not active, cannot reload.
2021-08-26 05:53:08 WARNING unit.ceph-radosgw/0.certificates-relation-changed logger.go:60 Job for apache2.service failed because the control process exited with error code.
2021-08-26 05:53:08 WARNING unit.ceph-radosgw/0.certificates-relation-changed logger.go:60 See "systemctl status apache2.service" and "journalctl -xe" for details.
2021-08-26 05:53:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 05:53:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: fsid
2021-08-26 05:53:09 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:53:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:53:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:53:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:53:09 INFO juju.worker.uniter.operation runhook.go:145 ran "certificates-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 05:56:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:56:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:56:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:56:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 05:56:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 05:56:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 05:56:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 05:56:06 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:56:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:56:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Loaded template from templates/ceph.conf
2021-08-26 05:56:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Rendering from template: /etc/ceph/ceph.conf
2021-08-26 05:56:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Wrote template /etc/ceph/ceph.conf.
2021-08-26 05:56:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Making dir /var/lib/ceph/radosgw/ceph-rgw.juju-8a5801-0-lxd-1 ceph:ceph 750
2021-08-26 05:56:06 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Symlinking /var/lib/ceph/radosgw/ceph-rgw.juju-8a5801-0-lxd-1/keyring as /etc/ceph/ceph.client.rgw.juju-8a5801-0-lxd-1.keyring
2021-08-26 05:56:06 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Synchronizing state of radosgw.service with SysV service script with /lib/systemd/systemd-sysv-install.
2021-08-26 05:56:06 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable radosgw
2021-08-26 05:56:06 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Unit /etc/systemd/system/radosgw.service is masked, ignoring.
2021-08-26 05:56:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Installing python-dbus with options: ['--option=Dpkg::Options::=--force-confold']
2021-08-26 05:56:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Check command not found: check_disk
2021-08-26 05:56:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Check command not found: check_systemd.py
2021-08-26 05:56:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Check command not found: check_systemd.py
2021-08-26 05:56:07 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Nagios user not set up, nrpe checks not updated
2021-08-26 05:56:07 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Created symlink /etc/systemd/system/ceph-radosgw.target.wants/ceph-radosgw@rgw.juju-8a5801-0-lxd-1.service → /lib/systemd/system/ceph-radosgw@.service.
2021-08-26 05:56:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 05:56:08 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:56:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:56:08 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 05:56:09 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:56:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:56:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:56:09 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:56:10 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 05:56:34 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:56:34 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:56:34 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 05:56:35 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:56:35 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 05:56:36 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:56:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: service_port service_host auth_host auth_port admin_tenant_name admin_user admin_password
2021-08-26 05:56:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:56:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity relation's interface, identity-service, is related awaiting the following data from the relationship: service_port, service_host, auth_host, auth_port, admin_tenant_name, admin_user, admin_password. 
2021-08-26 05:56:36 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 05:59:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 05:59:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/ceph/ceph.conf
2021-08-26 05:59:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:59:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:59:37 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: HAProxy context is incomplete, this unit has no peers.
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 05:59:38 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Loaded template from templates/ceph.conf
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Rendering from template: /etc/ceph/ceph.conf
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Wrote template /etc/ceph/ceph.conf.
2021-08-26 05:59:38 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 05:59:39 INFO juju.worker.uniter.operation runhook.go:145 ran "identity-service-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:01:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:01:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:01:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:01:42 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:01:43 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:01:43 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:01:43 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:01:44 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:06:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:06:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:06:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:06:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:06:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:06:45 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:06:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:06:46 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:12:12 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:12:12 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:12:12 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:12:13 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:12:13 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:12:13 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:12:13 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:12:14 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:16:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:16:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:16:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:16:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:16:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:16:46 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:16:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:16:47 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:21:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:21:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:21:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:21:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:21:04 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:21:05 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:21:05 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:21:05 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:24:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:24:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:24:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:24:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Making dir /etc/apache2/ssl/ceph-radosgw root:root 555
2021-08-26 06:24:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Installing CA certificate from certificate relation
2021-08-26 06:24:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Installing new CA cert at: /usr/local/share/ca-certificates/vault_juju_ca_cert.crt
2021-08-26 06:24:14 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:24:14 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 06:24:14 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 06:24:14 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 06:24:14 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Missing required data: fsid
2021-08-26 06:24:15 WARNING unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:24:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Loaded template from templates/ceph.conf
2021-08-26 06:24:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Rendering from template: /etc/ceph/ceph.conf
2021-08-26 06:24:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Wrote template /etc/ceph/ceph.conf.
2021-08-26 06:24:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/openstack_https_frontend.conf
2021-08-26 06:24:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Rendering from template: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:24:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: Wrote template /etc/apache2/sites-available/openstack_https_frontend.conf.
2021-08-26 06:24:15 WARNING unit.ceph-radosgw/0.certificates-relation-changed logger.go:60 apache2.service is not active, cannot reload.
2021-08-26 06:24:15 INFO unit.ceph-radosgw/0.juju-log server.go:314 certificates:84: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:24:16 INFO juju.worker.uniter.operation runhook.go:145 ran "certificates-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:25:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:25:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:25:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:25:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:25:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 06:25:45 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:25:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:25:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 06:25:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 06:25:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 06:25:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Missing required data: fsid
2021-08-26 06:25:47 WARNING unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:25:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Loaded template from templates/ceph.conf
2021-08-26 06:25:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Rendering from template: /etc/ceph/ceph.conf
2021-08-26 06:25:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Wrote template /etc/ceph/ceph.conf.
2021-08-26 06:25:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/openstack_https_frontend.conf
2021-08-26 06:25:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Rendering from template: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:25:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: Wrote template /etc/apache2/sites-available/openstack_https_frontend.conf.
2021-08-26 06:25:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 identity-service:47: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:25:48 INFO juju.worker.uniter.operation runhook.go:145 ran "identity-service-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:26:55 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:26:55 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:26:55 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:26:55 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:26:55 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:26:56 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:26:56 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:26:57 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:26:57 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:32:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:32:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:32:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:32:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:32:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:32:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:32:25 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:32:25 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:32:26 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:37:21 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:37:21 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:37:21 INFO unit.ceph-radosgw/0.juju-log server.go:314 Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:37:21 INFO unit.ceph-radosgw/0.juju-log server.go:314 Updating status.
2021-08-26 06:37:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:37:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 Missing required data: fsid
2021-08-26 06:37:22 WARNING unit.ceph-radosgw/0.juju-log server.go:314 Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:37:23 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:37:23 INFO juju.worker.uniter.operation runhook.go:145 ran "update-status" hook (via explicit, bespoke hook script)
2021-08-26 06:39:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:39:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:39:44 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:39:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:39:45 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 06:39:45 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 06:39:46 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:39:46 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:39:46 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-departed" hook (via explicit, bespoke hook script)
2021-08-26 06:39:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:39:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:39:47 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:39:48 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:39:48 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 06:39:48 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: fsid
2021-08-26 06:39:49 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:39:49 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:39:50 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-departed" hook (via explicit, bespoke hook script)
2021-08-26 06:39:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:39:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:39:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:39:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:39:51 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 06:39:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Missing required data: mon_hosts fsid
2021-08-26 06:39:52 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:46: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:39:52 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:46: mon relation's interface, mon, is related awaiting the following data from the relationship: mon_hosts, fsid. 
2021-08-26 06:39:53 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-departed" hook (via explicit, bespoke hook script)
2021-08-26 06:39:53 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-broken" hook (missing)
2021-08-26 06:40:19 INFO juju.worker.uniter.relation statetracker.go:159 joining relation "ceph-radosgw:mon ceph-mon:radosgw"
2021-08-26 06:40:19 INFO juju.worker.uniter.relation statetracker.go:195 joined relation "ceph-radosgw:mon ceph-mon:radosgw"
2021-08-26 06:40:19 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-created" hook (missing)
2021-08-26 06:40:19 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-joined" hook (missing)
2021-08-26 06:40:20 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:20 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:40:20 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:21 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:40:21 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Inconsistent or absent auth returned by mon units. Setting auth_supported to 'none'
2021-08-26 06:40:21 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Missing required data: fsid
2021-08-26 06:40:21 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:40:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: mon relation's interface, mon, is related awaiting the following data from the relationship: fsid. 
2021-08-26 06:40:22 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:40:23 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-joined" hook (missing)
2021-08-26 06:40:23 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:23 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:40:23 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:24 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:40:25 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:40:26 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:40:26 INFO juju.worker.uniter.operation runhook.go:148 skipped "mon-relation-joined" hook (missing)
2021-08-26 06:40:26 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:26 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:40:26 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:27 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:40:28 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:40:29 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:40:30 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:30 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:40:30 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:30 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:40:31 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:40:32 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:40:33 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:33 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:40:33 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:34 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:40:34 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:40:35 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:40:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:40:36 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:37 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:40:38 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:40:38 INFO juju.worker.uniter.operation runhook.go:145 ran "mon-relation-changed" hook (via explicit, bespoke hook script)
2021-08-26 06:40:48 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:48 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/ceph/ceph.conf
2021-08-26 06:40:48 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Registered config file: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:49 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: HAProxy context is incomplete, this unit has no peers.
2021-08-26 06:40:49 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/haproxy.cfg
2021-08-26 06:40:49 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Rendering from template: /etc/haproxy/haproxy.cfg
2021-08-26 06:40:49 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Wrote template /etc/haproxy/haproxy.cfg.
2021-08-26 06:40:50 WARNING unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Package python-keystonemiddleware has no installation candidate.
2021-08-26 06:40:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Loaded template from templates/ceph.conf
2021-08-26 06:40:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Rendering from template: /etc/ceph/ceph.conf
2021-08-26 06:40:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Wrote template /etc/ceph/ceph.conf.
2021-08-26 06:40:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Loaded template from /var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/templates/openstack_https_frontend.conf
2021-08-26 06:40:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Rendering from template: /etc/apache2/sites-available/openstack_https_frontend.conf
2021-08-26 06:40:50 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Wrote template /etc/apache2/sites-available/openstack_https_frontend.conf.
2021-08-26 06:40:50 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Synchronizing state of radosgw.service with SysV service script with /lib/systemd/systemd-sysv-install.
2021-08-26 06:40:50 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Executing: /lib/systemd/systemd-sysv-install disable radosgw
2021-08-26 06:40:51 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Unit /etc/systemd/system/radosgw.service is masked, ignoring.
2021-08-26 06:40:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Installing python-dbus with options: ['--option=Dpkg::Options::=--force-confold']
2021-08-26 06:40:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Check command not found: check_disk
2021-08-26 06:40:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Check command not found: check_systemd.py
2021-08-26 06:40:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Check command not found: check_systemd.py
2021-08-26 06:40:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Check command not found: check_systemd.py
2021-08-26 06:40:51 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Nagios user not set up, nrpe checks not updated
2021-08-26 06:40:52 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Retrying '_check_output' 5 more times (delay=3)
2021-08-26 06:40:55 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Retrying '_check_output' 4 more times (delay=6)
2021-08-26 06:41:01 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Retrying '_check_output' 3 more times (delay=9)
2021-08-26 06:41:10 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Retrying '_check_output' 2 more times (delay=12)
2021-08-26 06:41:22 INFO unit.ceph-radosgw/0.juju-log server.go:314 mon:86: Retrying '_check_output' 1 more times (delay=15)
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 Traceback (most recent call last):
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/mon-relation-changed", line 748, in <module>
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     hooks.execute(sys.argv)
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/core/hookenv.py", line 963, in execute
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     self._hooks[hook_name]()
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/mon-relation-changed", line 372, in mon_relation
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     _mon_relation()
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1903, in wrapped_f
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     return restart_on_change_helper(
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/core/host.py", line 837, in restart_on_change_helper
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     r = lambda_f()
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1904, in <lambda>
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     (lambda: f(*args, **kwargs)),
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/mon-relation-changed", line 343, in _mon_relation
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     existing_zones = multisite.list_zones()
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/core/decorators.py", line 40, in _retry_on_exception_inner_2
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     return f(*args, **kwargs)
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/multisite.py", line 96, in list_zones
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     _zones = _list('zone')
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/multisite.py", line 72, in _list
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     result = json.loads(_check_output(cmd))
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/charmhelpers/core/decorators.py", line 40, in _retry_on_exception_inner_2
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     return f(*args, **kwargs)
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/var/lib/juju/agents/unit-ceph-radosgw-0/charm/hooks/multisite.py", line 33, in _check_output
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     return subprocess.check_output(cmd, stderr=subprocess.PIPE).decode('UTF-8')
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 415, in check_output
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60   File "/usr/lib/python3.8/subprocess.py", line 516, in run
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60     raise CalledProcessError(retcode, process.args,
2021-08-26 06:41:37 WARNING unit.ceph-radosgw/0.mon-relation-changed logger.go:60 subprocess.CalledProcessError: Command '['radosgw-admin', '--id=rgw.juju-8a5801-0-lxd-1', 'zone', 'list']' returned non-zero exit status 2.
2021-08-26 06:41:38 ERROR juju.worker.uniter.operation runhook.go:139 hook "mon-relation-changed" (via explicit, bespoke hook script) failed: exit status 1
2021-08-26 06:41:38 INFO juju.worker.uniter resolver.go:144 awaiting error resolution for "relation-changed" hook

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.