Frequent deployment failure due to attempting to talk HTTP to a HTTPS service

Bug #1930654 reported by Frode Nordahl
This bug affects 2 people
Affects Status Importance Assigned to Milestone
OpenStack Glance-Simplestreams-Sync Charm

Bug Description

Not quite sure where the root of the issue is, but we frequently see this during deployment:
Traceback (most recent call last):
  File "/snap/simplestreams/27/bin/sstream-mirror-glance", line 185, in <module>
  File "/snap/simplestreams/27/bin/sstream-mirror-glance", line 181, in main
    tmirror.sync(smirror, args.path)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/simplestreams/mirrors/", line 91, in sync
    return self.sync_index(reader, path, data, content)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/simplestreams/mirrors/", line 254, in sync_index
    self.sync(reader, path=epath)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/simplestreams/mirrors/", line 89, in sync
    return self.sync_products(reader, path, data, content)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/simplestreams/mirrors/", line 269, in sync_products
    target = self.load_products(path, content_id)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/simplestreams/mirrors/", line 204, in load_products
    for image in images:
  File "/snap/simplestreams/27/lib/python3.6/site-packages/glanceclient/common/", line 581, in __next__
    return self._next()
  File "/snap/simplestreams/27/lib/python3.6/site-packages/glanceclient/common/", line 570, in _next
    obj, resp = next(self._self_wrapped)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/glanceclient/v2/", line 184, in list
    for image, resp in paginate(url, page_size, limit):
  File "/snap/simplestreams/27/lib/python3.6/site-packages/glanceclient/v2/", line 111, in paginate
    resp, body = self.http_client.get(next_url, headers=req_id_hdr)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/keystoneauth1/", line 386, in get
    return self.request(url, 'GET', **kwargs)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/glanceclient/common/", line 387, in request
    return self._handle_response(resp)
  File "/snap/simplestreams/27/lib/python3.6/site-packages/glanceclient/common/", line 126, in _handle_response
    raise exc.from_response(resp, resp.content)
glanceclient.exc.HTTPBadRequest: HTTP 400 Bad Request: Bad Request: Your browser sent a request that this server could not understand.: Reason: You're speaking plain HTTP to an SSL-enabled server port.: Instead use the HTTPS scheme to access this URL, please.: Apache/2.4.29 (Ubuntu) Server at Port 443

Revision history for this message
Frode Nordahl (fnordahl) wrote :

simplestreams uses the Keystone catalog to find endpoints.

The offending requests do come in through the haproxy running on the Glance unit so it's almost as if there is a mis-configuration there?

Jun 2 22:53:27 juju-f2b745-zaza-531e4489bf5e-0 haproxy[15467]: [02/Jun/2021:22:53:27.815] tcp-in_glance_api glance_api_172.16.0.87/glance-0 1/0/7 622 -- 1/1/0/0/0 0/0
Jun 2 22:53:38 juju-f2b745-zaza-531e4489bf5e-0 haproxy[15467]: [02/Jun/2021:22:53:38.994] tcp-in_glance_api glance_api_172.16.0.87/glance-0 1/0/3 622 -- 1/1/0/0/0 0/0
Jun 2 22:53:49 juju-f2b745-zaza-531e4489bf5e-0 haproxy[15467]: [02/Jun/2021:22:53:49.689] tcp-in_glance_api glance_api_172.16.0.87/glance-0 1/0/7 622 -- 1/1/0/0/0 0/0

glance_0/var/log/apache2/other_vhosts_access.log: - - [02/Jun/2021:22:53:27 +0000] "GET / HTTP/1.0" 400 0 "-" "-" - - [02/Jun/2021:22:53:38 +0000] "GET / HTTP/1.0" 400 0 "-" "-" - - [02/Jun/2021:22:53:49 +0000] "GET / HTTP/1.0" 400 0 "-" "-"

The crashdump does not contain the relevant configuration files, so it's hard to tell.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.