Even though we request keys from ceph with an rbd-mirror profile the rbd-mirror process appears to not be able to interact with the Ceph cluster in the way it expects at Octopus.
The first side effect of this is that Ceph will mark any mirrored image/pool as being in a WARNING state, despite the fact that data appears to be mirrored, subsequently the charm will report this and be stuck in a blocked state.
Even though we request keys from ceph with an rbd-mirror profile the rbd-mirror process appears to not be able to interact with the Ceph cluster in the way it expects at Octopus.
Enabling debug log on the MON may give log output such as: 20T15:54: 08.425042+ 0000 mon.juju- e32644- zaza-048032ef4d d5-7 (mon.1) 960 : audit [DBG] from='client.? 172.20. 0.52:0/ 1474256700' entity= 'client. rbd-mirror. juju-e32644- zaza-048032ef4d d5-13' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/ peer/2/ eb2ee01a- 9a02-40da- 950b-4ddc1f5e9e 26"}]: access denied 20T15:54: 08.427957+ 0000 mon.juju- e32644- zaza-048032ef4d d5-7 (mon.1) 961 : audit [DBG] from='client.? 172.20. 0.52:0/ 1474256700' entity= 'client. rbd-mirror. juju-e32644- zaza-048032ef4d d5-13' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/ peer/3/ b8a91922- bda0-4ecc- 9ffb-031e448311 fe"}]: access denied 20T15:54: 08.429413+ 0000 mon.juju- e32644- zaza-048032ef4d d5-7 (mon.1) 962 : audit [DBG] from='client.? 172.20. 0.52:0/ 1474256700' entity= 'client. rbd-mirror. juju-e32644- zaza-048032ef4d d5-13' cmd=[{"prefix": "config-key get", "key": "rbd/mirror/ site_name" }]: access denied
2020-05-
2020-05-
2020-05-
The first side effect of this is that Ceph will mark any mirrored image/pool as being in a WARNING state, despite the fact that data appears to be mirrored, subsequently the charm will report this and be stuck in a blocked state.