We've seen this quite a bit over the last few weeks since 1.25.5 was released; deployments will fail as units cannot get either a private-address or a public-address at some point during hook execution - for example:
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 error: private-address not set
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 Traceback (most recent call last):
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/install.real", line 579, in <module>
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 assess_status(CONFIGS)
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/cinder_utils.py", line 886, in assess_status
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 assess_status_func(configs)()
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1530, in _assess_status_func
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 state, message = _determine_os_workload_status(*args, **kwargs)
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 930, in _determine_os_workload_status
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 configs, required_interfaces)
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 984, in _ows_check_generic_interfaces
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 required_interfaces)
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/utils.py", line 1265, in incomplete_relation_data
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 complete_ctxts = configs.complete_contexts()
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 295, in complete_contexts
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 for i in six.itervalues(self.templates)]
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 120, in complete_contexts
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 self.context()
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/templating.py", line 105, in context
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 _ctxt = context()
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/contrib/openstack/context.py", line 592, in __call__
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 addr = get_host_ip(unit_get('private-address'))
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/core/hookenv.py", line 74, in wrapper
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 res = func(*args, **kwargs)
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/var/lib/juju/agents/unit-cinder-0/charm/hooks/charmhelpers/core/hookenv.py", line 624, in unit_get
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 return json.loads(subprocess.check_output(_args).decode('UTF-8'))
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 File "/usr/lib/python2.7/subprocess.py", line 573, in check_output
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 raise CalledProcessError(retcode, cmd, output=output)
unit-cinder-0[3537]: 2016-05-18 10:26:07 INFO unit.cinder/0.install logger.go:40 subprocess.CalledProcessError: Command '['unit-get', '--format=json', 'private-address']' returned non-zero exit status 1
This does not happen consistently, but we're hitting it multiple times a day atm with just a light development load.
juju status on the install is odd as well:
https:/ /openstack- ci-reports. ubuntu. com/artifacts/ test_charm_ pipeline/ openstack/ charm-ceph/ 317910/ 1/2016- 05-18_08- 48-05/test_ charm_amulet_ smoke/juju- stat-tabular- collect. txt