Build "Ubuntu 12.04.3 LTS" 2.1-7~icehouse : Api server could not connect to keystone due to authentication error

I see a strange keystone client error(no clue about the cause).

Ajay, Have you seen this issue before? The file "/tmp/keystone-signing-bdVaLU/signing_cert.pem" does exist and with correct permission.

127.0.0.1 - - [2015-01-20 17:47:27] "GET / HTTP/1.1" 401 197 0.000389
ERROR:keystoneclient.middleware.auth_token:CMS Verify output: Error opening certificate file /tmp/keystone-signing-bdVaLU/signing_cert.pem
140091113670304:error:02001002:system library:fopen:No such file or directory:bss_file.c:169:fopen('/tmp/keystone-signing-bdVaLU/signing_cert.pem','r')
140091113670304:error:2006D080:BIO routines:BIO_new_file:no such file:bss_file.c:172:

WARNING:keystoneclient.middleware.auth_token:Authorization failed for token
127.0.0.1 - - [2015-01-20 17:47:27] "GET / HTTP/1.1" 401 197 0.055778
Traceback (most recent call last):
  File "/usr/lib/pymodules/python2.7/gevent/greenlet.py", line 328, in run
    result = self._run(*self.args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/__init__.py", line 593, in _get_api_connection
    tenant_name=self._admin_tenant)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 185, in __init__
    retry_on_error=False)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 381, in _request
    content = self._request(op, url, data=data, retry_after_authn=True)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 406, in _request
    raise HttpError(status, content)
HttpError: HTTP Status: 401 Content: Authentication required
<Greenlet at 0x48470f0: <bound method ResourceApiDriver._get_api_connection of <vnc_openstack.ResourceApiDriver object at 0x484ec90>>> failed with HttpError

Thanks, Prakash

From: Sandip Dey
Sent: Tuesday, January 20, 2015 10:14 AM
To: Nagabhushana R; Prakash M Bailkeri
Cc: Senthilnathan Murugappan
Subject: Re: [Build "Ubuntu 12.04.3 LTS" 2.1-7~icehouse] vm_regression MultiNode Report

The setup is on hold, can be used.

Logs saved at /cs-shared/test_runs/nodei34/2015_01_20_16_49_59

Regards
Sandip

From: Nagabhushana R <email address hidden>
Date: Tuesday, January 20, 2015 11:40 PM
To: Sandip Dey <email address hidden>, Prakash M Bailkeri <email address hidden>
Cc: Senthilnathan Murugappan <email address hidden>
Subject: Re: [Build "Ubuntu 12.04.3 LTS" 2.1-7~icehouse] vm_regression MultiNode Report

+ Prakash

Prakash this is on build 7 R2.1. Could you check.

--
Bhushana

On Jan 20, 2015, at 11:33 PM, Sandip Dey <email address hidden>
 wrote:

I see this error in contrail-api log.

Senthil,could you have someone to take a look

27.0.0.1 - - [2015-01-20 18:03:13] "POST /fqname-to-id HTTP/1.1" 404 189 0.023040
ERROR:stevedore.extension:error calling 'xxx': 'NoneType' object has no attribute 'security_group_create'
ERROR:stevedore.extension:'NoneType' object has no attribute 'security_group_create'
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 247, in _invoke_one_plugin
    response_callback(func(e, *args, **kwds))
  File "/usr/lib/python2.7/dist-packages/stevedore/extension.py", line 221, in _call_extension_method
    return getattr(extension.obj, method_name)(*args, **kwds)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/__init__.py", line 691, in post_project_create
    self._create_default_security_group(proj_dict)
  File "/usr/lib/python2.7/dist-packages/vnc_openstack/__init__.py", line 654, in _create_default_security_group
    self._vnc_lib.security_group_create(sg_obj)
AttributeError: 'NoneType' object has no attribute 'security_group_create'
127.0.0.1 - - [2015-01-20 18:03:13] "POST /projects HTTP/1.1" 200 488 0.021445