Hello, Sofi, Jon: I have tested the purposed fix in our testing environment, but now we are getting permission issues:

Any updates on this?

root@volume-25018ecd-acf9-51dd-bcaa-d20cb0d49ae5:/etc/ceph# rbd -c /etc/ceph/ceph.conf -n client.volumes -k /etc/ceph/ceph.client.volumes.keyring -p images snap create 90f29707-8d2e-45bb-af05-baa2ab325d93@test --debug-ms=1 --debug-rbd=20
2021-06-14T23:09:37.098+0000 7fb2f30c41c0  1  Processor -- start
2021-06-14T23:09:37.098+0000 7fb2f30c41c0  1 --  start start
2021-06-14T23:09:37.098+0000 7fb2f30c41c0  1 --2-  >> v2:172.18.0.7:3300/0 conn(0x55d46cecaee0 0x55d46cecb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2021-06-14T23:09:37.098+0000 7fb2f30c41c0  1 --2-  >> v2:172.18.0.6:3300/0 conn(0x55d46ce39a80 0x55d46ced2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect
2021-06-14T23:09:37.098+0000 7fb2f30c41c0  1 --  --> v1:172.18.0.6:6789/0 -- auth(proto 0 32 bytes epoch 0) v1 -- 0x55d46cda3370 con 0x55d46cecb7b0
2021-06-14T23:09:37.098+0000 7fb2f30c41c0  1 --  --> v2:172.18.0.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d46cdb4bf0 con 0x55d46ce39a80
2021-06-14T23:09:37.098+0000 7fb2f30c41c0  1 --  --> v2:172.18.0.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d46cdb4d30 con 0x55d46cecaee0
2021-06-14T23:09:37.102+0000 7fb2f1cf9700  1 --2-  >> v2:172.18.0.6:3300/0 conn(0x55d46ce39a80 0x55d46ced2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2021-06-14T23:09:37.102+0000 7fb2f0cf7700  1 --1-  >> v1:172.18.0.6:6789/0 conn(0x55d46cecb7b0 0x55d46ce391d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.18.0.6:6789/0 says I am v1:172.18.0.28:60048/0 (socket says 172.18.0.28:60048)
2021-06-14T23:09:37.102+0000 7fb2f0cf7700  1 -- 172.18.0.28:0/3517608923 learned_addr learned my addr 172.18.0.28:0/3517608923 (peer_addr_for_me v1:172.18.0.28:0/0)
2021-06-14T23:09:37.102+0000 7fb2f14f8700  1 --2- 172.18.0.28:0/3517608923 >> v2:172.18.0.7:3300/0 conn(0x55d46cecaee0 0x55d46cecb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0
2021-06-14T23:09:37.102+0000 7fb2f1cf9700  1 --2- 172.18.0.28:0/3517608923 >> v2:172.18.0.6:3300/0 conn(0x55d46ce39a80 0x55d46ced2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_bad_method method=2 result (13) Permission denied, allowed methods=[2], allowed modes=[2,1]
2021-06-14T23:09:37.102+0000 7fb2f1cf9700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2021-06-14T23:09:37.102+0000 7fb2f1cf9700  1 -- 172.18.0.28:0/3517608923 >> v2:172.18.0.6:3300/0 conn(0x55d46ce39a80 msgr2=0x55d46ced2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2021-06-14T23:09:37.102+0000 7fb2f1cf9700  1 --2- 172.18.0.28:0/3517608923 >> v2:172.18.0.6:3300/0 conn(0x55d46ce39a80 0x55d46ced2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2021-06-14T23:09:37.102+0000 7fb2e3fff700  1 -- 172.18.0.28:0/3517608923 <== mon.0 v1:172.18.0.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882583370 0 0) 0x55d46cda3370 con 0x55d46cecb7b0
2021-06-14T23:09:37.102+0000 7fb2e3fff700  1 -- 172.18.0.28:0/3517608923 --> v1:172.18.0.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2dc001e10 con 0x55d46cecb7b0
2021-06-14T23:09:37.102+0000 7fb2f14f8700  1 --2- 172.18.0.28:0/3517608923 >> v2:172.18.0.7:3300/0 conn(0x55d46cecaee0 0x55d46cecb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_bad_method method=2 result (13) Permission denied, allowed methods=[2], allowed modes=[2,1]
2021-06-14T23:09:37.102+0000 7fb2f14f8700 -1 monclient(hunting): handle_auth_bad_method server allowed_methods [2] but i only support [2]
2021-06-14T23:09:37.102+0000 7fb2f14f8700  1 -- 172.18.0.28:0/3517608923 >> v2:172.18.0.7:3300/0 conn(0x55d46cecaee0 msgr2=0x55d46cecb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
2021-06-14T23:09:37.102+0000 7fb2f14f8700  1 --2- 172.18.0.28:0/3517608923 >> v2:172.18.0.7:3300/0 conn(0x55d46cecaee0 0x55d46cecb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2021-06-14T23:09:37.102+0000 7fb2e3fff700  1 -- 172.18.0.28:0/3517608923 <== mon.0 v1:172.18.0.6:6789/0 2 ==== auth_reply(proto 2 -13 (13) Permission denied) v1 ==== 222+0+0 (unknown 1993487795 0 0) 0x7fb2dc001e10 con 0x55d46cecb7b0
2021-06-14T23:09:37.102+0000 7fb2e3fff700  1 -- 172.18.0.28:0/3517608923 >> v1:172.18.0.6:6789/0 conn(0x55d46cecb7b0 legacy=0x55d46ce391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
2021-06-14T23:09:37.102+0000 7fb2f30c41c0  1 -- 172.18.0.28:0/3517608923 shutdown_connections 
2021-06-14T23:09:37.102+0000 7fb2f30c41c0  1 --2- 172.18.0.28:0/3517608923 >> v2:172.18.0.6:3300/0 conn(0x55d46ce39a80 0x55d46ced2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2021-06-14T23:09:37.102+0000 7fb2f30c41c0  1 --2- 172.18.0.28:0/3517608923 >> v2:172.18.0.7:3300/0 conn(0x55d46cecaee0 0x55d46cecb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop
2021-06-14T23:09:37.102+0000 7fb2f30c41c0  1 -- 172.18.0.28:0/3517608923 >> 172.18.0.28:0/3517608923 conn(0x55d46ce3dec0 msgr2=0x55d46cec4270 unknown :-1 s=STATE_NONE l=0).mark_down
2021-06-14T23:09:37.102+0000 7fb2f30c41c0  1 -- 172.18.0.28:0/3517608923 shutdown_connections 
2021-06-14T23:09:37.106+0000 7fb2f30c41c0  1 -- 172.18.0.28:0/3517608923 wait complete.
rbd: couldn't connect to the cluster!