I'm seeing the same messages on OpenStack Victoria 22.1.0. I set log level to debug, here's my output:
Apr 06 15:04:54 infra1-glance-container-99614ac2 glance-wsgi-api[1824]: 2021-04-06 15:04:54.274 1824 INFO glance.api.v2.image_data [req-c572bb10-58e1-4006-8f0e-9bd721b2986b 956806468e9f43dbaad1807a5208de52 ebe0fe5f3893495e82598c07716f5d45 - default default] Unable to create trust: no such option collect_timing in group [keystone_authtoken] Use the existing user token. Apr 06 15:07:14 infra1-glance-container-99614ac2 glance-wsgi-api[1837]: 2021-04-06 15:07:10.195 1837 ERROR keystonemiddleware.auth_token [req-ad8d0db9-b630-4237-9fff-d7ff282155d2 956806468e9f43dbaad1807a5208de52 ebe0fe5f3893495e82598c07716f5d45 - default default] Bad response code while validating token: 500 An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-55767c13-a450-4f81-90ab-5a7af6b3f672): keystoneauth1.exceptions.http.InternalServerError: An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-55767c13-a450-4f81-90ab-5a7af6b3f672) Apr 06 15:07:40 infra1-glance-container-99614ac2 glance-wsgi-api[1837]: 2021-04-06 15:07:38.197 1837 WARNING keystonemiddleware.auth_token [req-ad8d0db9-b630-4237-9fff-d7ff282155d2 956806468e9f43dbaad1807a5208de52 ebe0fe5f3893495e82598c07716f5d45 - default default] Identity response: {"error": {"code": 500, "title": "Internal Server Error", "message": "An unexpected error prevented the server from fulfilling your request."}}: keystoneauth1.exceptions.http.InternalServerError: An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-55767c13-a450-4f81-90ab-5a7af6b3f672) Apr 06 15:07:46 infra1-glance-container-99614ac2 uwsgi[1822]: DAMN ! worker 13 (pid: 1836) died, killed by signal 9 :( trying respawn ... Apr 06 15:07:46 infra1-glance-container-99614ac2 uwsgi[1822]: Respawned uWSGI worker 13 (new pid: 5799) Apr 06 15:07:44 infra1-glance-container-99614ac2 glance-wsgi-api[1837]: 2021-04-06 15:07:40.427 1837 CRITICAL keystonemiddleware.auth_token [req-ad8d0db9-b630-4237-9fff-d7ff282155d2 956806468e9f43dbaad1807a5208de52 ebe0fe5f3893495e82598c07716f5d45 - default default] Unable to validate token: Failed to fetch token data from identity server: keystonemiddleware.auth_token._exceptions.ServiceError: Failed to fetch token data from identity server Apr 06 15:07:46 infra1-glance-container-99614ac2 uwsgi[1837]: Tue Apr 6 15:07:45 2021 - uwsgi_response_writev_headers_and_body_do(): Connection reset by peer [core/writer.c line 306] during GET /v2/images?limit=1000&sort_key=created_at&sort_dir=desc (192.168.110.250) Apr 06 15:07:45 infra1-glance-container-99614ac2 glance-wsgi-api[1837]: 2021-04-06 15:07:45.629 1837 CRITICAL glance [req-ad8d0db9-b630-4237-9fff-d7ff282155d2 956806468e9f43dbaad1807a5208de52 ebe0fe5f3893495e82598c07716f5d45 - default default] Unhandled error: OSError: write error 2021-04-06 15:07:45.629 1837 ERROR glance OSError: write error 2021-04-06 15:07:45.629 1837 ERROR glance
Kind regards, Oliver
I'm seeing the same messages on OpenStack Victoria 22.1.0. I set log level to debug, here's my output:
Apr 06 15:04:54 infra1- glance- container- 99614ac2 glance- wsgi-api[ 1824]: 2021-04-06 15:04:54.274 1824 INFO glance. api.v2. image_data [req-c572bb10- 58e1-4006- 8f0e-9bd721b298 6b 956806468e9f43d baad1807a5208de 52 ebe0fe5f3893495 e82598c07716f5d 45 - default default] Unable to create trust: no such option collect_timing in group [keystone_ authtoken] Use the existing user token. glance- container- 99614ac2 glance- wsgi-api[ 1837]: 2021-04-06 15:07:10.195 1837 ERROR keystonemiddlew are.auth_ token [req-ad8d0db9- b630-4237- 9fff-d7ff282155 d2 956806468e9f43d baad1807a5208de 52 ebe0fe5f3893495 e82598c07716f5d 45 - default default] Bad response code while validating token: 500 An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-55767c13- a450-4f81- 90ab-5a7af6b3f6 72): keystoneauth1. exceptions. http.InternalSe rverError: An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-55767c13- a450-4f81- 90ab-5a7af6b3f6 72) glance- container- 99614ac2 glance- wsgi-api[ 1837]: 2021-04-06 15:07:38.197 1837 WARNING keystonemiddlew are.auth_ token [req-ad8d0db9- b630-4237- 9fff-d7ff282155 d2 956806468e9f43d baad1807a5208de 52 ebe0fe5f3893495 e82598c07716f5d 45 - default default] Identity response: {"error": {"code": 500, "title": "Internal Server Error", "message": "An unexpected error prevented the server from fulfilling your request."}}: keystoneauth1. exceptions. http.InternalSe rverError: An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-55767c13- a450-4f81- 90ab-5a7af6b3f6 72) glance- container- 99614ac2 uwsgi[1822]: DAMN ! worker 13 (pid: 1836) died, killed by signal 9 :( trying respawn ... glance- container- 99614ac2 uwsgi[1822]: Respawned uWSGI worker 13 (new pid: 5799) glance- container- 99614ac2 glance- wsgi-api[ 1837]: 2021-04-06 15:07:40.427 1837 CRITICAL keystonemiddlew are.auth_ token [req-ad8d0db9- b630-4237- 9fff-d7ff282155 d2 956806468e9f43d baad1807a5208de 52 ebe0fe5f3893495 e82598c07716f5d 45 - default default] Unable to validate token: Failed to fetch token data from identity server: keystonemiddlew are.auth_ token._ exceptions. ServiceError: Failed to fetch token data from identity server glance- container- 99614ac2 uwsgi[1837]: Tue Apr 6 15:07:45 2021 - uwsgi_response_ writev_ headers_ and_body_ do(): Connection reset by peer [core/writer.c line 306] during GET /v2/images? limit=1000& sort_key= created_ at&sort_ dir=desc (192.168.110.250) glance- container- 99614ac2 glance- wsgi-api[ 1837]: 2021-04-06 15:07:45.629 1837 CRITICAL glance [req-ad8d0db9- b630-4237- 9fff-d7ff282155 d2 956806468e9f43d baad1807a5208de 52 ebe0fe5f3893495 e82598c07716f5d 45 - default default] Unhandled error: OSError: write error
2021- 04-06 15:07:45.629 1837 ERROR glance OSError: write error
2021- 04-06 15:07:45.629 1837 ERROR glance
Apr 06 15:07:14 infra1-
Apr 06 15:07:40 infra1-
Apr 06 15:07:46 infra1-
Apr 06 15:07:46 infra1-
Apr 06 15:07:44 infra1-
Apr 06 15:07:46 infra1-
Apr 06 15:07:45 infra1-
Kind regards,
Oliver