unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed partx: /dev/disk/by-id/nvme-Amazon_Elastic_Block_Store_vol048217c0729110399: failed to read partition table
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.juju-log mon:14: get partitions: []
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed Failed to find physical volume "/dev/nvme2n1".
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed Traceback (most recent call last):
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 642, in <module>
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed hooks.execute(sys.argv)
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/charmhelpers/core/hookenv.py", line 823, in execute
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed self._hooks[hook_name]()
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 537, in mon_relation
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed prepare_disks_and_activate()
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "/var/lib/juju/agents/unit-ceph-osd-1/charm/hooks/mon-relation-changed", line 461, in prepare_disks_and_activate
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed config('osd-encrypt-keymanager'))
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1413, in osdize
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed bluestore, key_manager)
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1470, in osdize_dev
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed if is_mapped_luks_device(dev):
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed File "lib/ceph/utils.py", line 1704, in is_mapped_luks_device
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed .format(os.path.basename(dev))))
unit-ceph-osd-1: 11:52:40 DEBUG unit.ceph-osd/1.mon-relation-changed StopIteration
ubuntu@ip-172-31-20-91:~$ ls /sys/class/block/nvme2n1/holders/
ubuntu@ip-172-31-20-91:~$
This is an empty directory on AWS.
Deployed with:
juju deploy -n 3 ceph-mon
juju deploy -n 3 ceph-osd --storage osd-devices=ebs,32G,2 --storage osd-journals=ebs,8G,1
juju add-relation ceph-mon ceph-osd
When I try to deploy onto AWS (on Xenial), I get more errors:
2018-08-21 13:51:18 DEBUG mon-relation- changed Failed to find physical volume "/dev/xvdh". 977f-485f- af46-2e9d3a287e af'] 8e3d-46c9- 8f19-6ca4664076 9f'] changed prepare_device: OSD will not be hot-swappable if journal is not the same device as the osd data changed Could not create partition 2 from 2099200 to 4196351 changed Setting name! changed partNum is 1 changed REALLY setting name! changed Unable to set partition 2's name to 'ceph journal'! changed Could not change partition 2's type code to 45b0969e- 9b03-4f30- b4c6-b4b80ceff1 06! changed Error encountered; not saving changes. changed Traceback (most recent call last): changed File "/usr/sbin/ ceph-disk" , line 9, in <module> changed load_entry_ point(' ceph-disk= =1.0.0' , 'console_scripts', 'ceph-disk')() changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 5372, in run changed main(sys.argv[1:]) changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 5325, in main changed main_catch( args.func, args) changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 5350, in main_catch changed func(args) changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 1900, in main changed Prepare. factory( args).prepare( ) changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 1889, in prepare changed self.prepare_ locked( ) changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 1920, in prepare_locked changed self.data. prepare( self.journal) changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 2588, in prepare changed self.prepare_ device( *to_prepare_ list) changed File "/usr/lib/ python2. 7/dist- packages/ ceph_disk/ main.py" , line 2750, in prepare_device
2018-08-21 13:51:27 DEBUG juju-log mon:1: get partitions: ['1 2048 2099199 2097152 1G ceph\\x20journal f3a44a58-
2018-08-21 13:51:27 DEBUG juju-log mon:1: get partitions: ['1 2048 2099199 2097152 1G ceph\\x20journal 29393ee0-
2018-08-21 13:51:27 INFO juju-log mon:1: osdize cmd: ['ceph-disk', 'prepare', '--fs-type', 'xfs', '/dev/xvdh', '/dev/xvdg']
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
2018-08-21 13:51:28 DEBUG mon-relation-
201...