creation of neutron-server endpoint failed in single controller and multi-compute job

Bug #1406570 reported by Jerry Zhao
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Compass
New
Critical
Sam Su

Bug Description

Creation of neutron server endpoint failed at 18:08 due to lack of keystone endpoint

http://10.145.81.112/logs/29/144129/6/check/compass-bare-e2e-single-contoller-multi-compute-experimental/3dc00a9/chef_logs/network.single-controller/chef-client.log

Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] INFO: Processing openstack-identity_register[Register Network API Service] action create_service (openstack-network::identity_registration line 43)
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Unable to create service 'neutron'
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Error was: No such file or directory - keystone
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] INFO: Processing openstack-identity_register[Register Network Endpoint] action create_endpoint (openstack-network::identity_registration line 53)
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Unable to create endpoint for service type 'network'
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Error was: No such file or directory - keystone
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] INFO: Processing openstack-identity_register[Register Service Tenant] action create_tenant (openstack-network::identity_registration line 65)
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Unable to create tenant 'service'
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Error was: No such file or directory - keystone
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] INFO: Processing openstack-identity_register[Register neutron User] action create_user (openstack-network::identity_registration line 74)
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Unable to create user 'neutron' for tenant 'service'
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Error was: No such file or directory - keystone
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] INFO: Processing openstack-identity_register[Grant 'admin' Role to neutron User for service Tenant] action grant_role (openstack-network::identity_registration line 84)
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Unable to grant role 'admin' to user 'neutron'
Dec 29 18:08:48 network network.single-controller [2014-12-29T18:08:48-08:00] ERROR: Error was: No such file or directory - keystone

While keystone endpoint was acctually created at 18:13:

http://10.145.81.112/logs/29/144129/6/check/compass-bare-e2e-single-contoller-multi-compute-experimental/3dc00a9/chef_logs/controller.single-controller/chef-client.log

Identity Service] action create_service (openstack-identity::registration line 101)
Dec 29 18:13:07 controller controller.single-controller [2014-12-29T18:13:06-08:00] INFO: Created service 'keystone'
Dec 29 18:13:07 controller controller.single-controller [2014-12-29T18:13:06-08:00] INFO: Processing openstack-identity_register[Register Identity Endpoint] action create_endpoint (openstack-identity::registration line 120)
Dec 29 18:13:08 controller controller.single-controller [2014-12-29T18:13:07-08:00] INFO: Created endpoint for service type 'identity'
Dec 29 18:13:08 controller controller.single-controller [2014-12-29T18:13:07-08:00] INFO: Processing package[python-keystoneclient] action upgrade (openstack-image::api line 37)
Dec 29 18:13:09 controller controller.single-controller [2014-12-29T18:13:08-08:00] INFO: Processing package[curl] action upgrade (o

This is another problem caused by race condition and the chef recipe didn't exit on failure to create endpoint in the mean time.

Jerry Zhao (zhaoxinyu)
Changed in compass:
importance: Undecided → Critical
assignee: nobody → Sam Su (sam-su)
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.