Ubuntu Cloud Archive

S3 API Broken For >= Kilo

  1. Series ocata
  2. Bug #1738063
Bug #1738063 reported by Edward Hope-Morley
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Swift Proxy Charm
Fix Released
Critical
Edward Hope-Morley
OpenStack Swift Proxy Charm 18.02
Ubuntu Cloud Archive
Fix Released
Undecided
Unassigned
Mitaka
Fix Committed
Undecided
Unassigned
Newton
Won't Fix
Undecided
Unassigned
Ocata
Fix Committed
Undecided
Unassigned
Pike
Fix Committed
Undecided
Unassigned
Queens
Fix Released
Undecided
Unassigned

Bug Description

Seems we got ahead of ourselves in commit 25a2ea7f and broke the S3 api by changing the swift3 middleware config to something that is not supported until the Newton version (1.11) of swift-plugin-s3. In the swift-proxy charm for >= Kilo we currently have:

--------------------
[filter:s3token]
paste.filter_factory = keystonemiddleware.s3_token:filter_factory
auth_uri = {{ auth_protocol }}://{{ keystone_host }}:{{ auth_port }}

[filter:swift3]
use = egg:swift3#swift3
--------------------

but that is broken in (at least) two ways; firstly swift3 (swift-plugin-s3) didn't switch to use auth_uri until 1.11 which is not available until Newton and secondly, when you switch to 1.11 you then need to change the s3token config to:

--------------------
[filter:s3token]
use = egg:swift3#s3token
auth_uri = http://127.0.0.1:35357/

[filter:swift3]
use = egg:swift3#swift3
--------------------

See original description
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-swift-proxy (master)

Fix proposed to branch: master
Review: https://review.openstack.org/527763

Changed in charm-swift-proxy:
status: Confirmed → In Progress
Edward Hope-Morley (hopem)
description: updated
Revision history for this message
Edward Hope-Morley (hopem) wrote :

Ok so there is an added issue here in that successive releases of ubuntu have newer versions of swift-plugin-s3 BUT the Ubuntu cloud archive does not (until Queens which has 1.12-1). So, I will need to modify my patch so that the same config is used until Queens and change at a later time for prior Xenial UCA releases should this ever get resolved.

[0] https://launchpad.net/ubuntu/+source/swift-plugin-s3
[1] http://reqorts.qa.ubuntu.com/reports/ubuntu-server/cloud-archive/queens_versions.html

Revision history for this message
Edward Hope-Morley (hopem) wrote :

And more issues... It seems that since Newton->Pike UCA do have newer deps such as python-keystonemiddleware it is not be (easily) possible to fix this properly for those versions. So I can and will fix for Kilo -> Mitaka but I will have to leave Newton -> Pike as they are for now and hopefully Queens will be released with working config.

Revision history for this message
Edward Hope-Morley (hopem) wrote :

And it seems that Trusty Mitaka UCA will also fall foul to this until the UCA packages are updated.

Revision history for this message
James Page (james-page) wrote :

Raising tasks for the UCA; Queens is already underway.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-swift-proxy (master)

Reviewed: https://review.openstack.org/527763
Committed: https://git.openstack.org/cgit/openstack/charm-swift-proxy/commit/?id=a256263c79236be8adc0ea5176c0e4512c5a135b
Submitter: Zuul
Branch: master

commit a256263c79236be8adc0ea5176c0e4512c5a135b
Author: Edward Hope-Morley <email address hidden>
Date: Wed Dec 13 19:10:56 2017 +0000

    Fix S3 API for >= Kilo

    From Kilo onwards the swift-proxy charm is
    misconfiguring the swift3 middleware such that
    the api is unable to respond to any requests.
    We fix this by providing working config for
    Kilo onwards.

    NOTE: see LP for full explanation but due to
    problems with package version mismatches in the
    UCA this patch only fixes Trusty Kilo, (L is
    EOL) and Xenial Mitaka.

    Change-Id: Ice5690e7f06ffc78dd20b53b67dffc6bd72b2613
    Closes-Bug: 1738063

Changed in charm-swift-proxy:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to charm-swift-proxy (stable/17.11)

Fix proposed to branch: stable/17.11
Review: https://review.openstack.org/528221

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to charm-swift-proxy (stable/17.11)

Reviewed: https://review.openstack.org/528221
Committed: https://git.openstack.org/cgit/openstack/charm-swift-proxy/commit/?id=37cfb1c504f1dbde40ff619b654355352618c939
Submitter: Zuul
Branch: stable/17.11

commit 37cfb1c504f1dbde40ff619b654355352618c939
Author: Edward Hope-Morley <email address hidden>
Date: Wed Dec 13 19:10:56 2017 +0000

    Fix S3 API for >= Kilo

    From Kilo onwards the swift-proxy charm is
    misconfiguring the swift3 middleware such that
    the api is unable to respond to any requests.
    We fix this by providing working config for
    Kilo onwards.

    NOTE: see LP for full explanation but due to
    problems with package version mismatches in the
    UCA this patch only fixes Trusty Kilo, (L is
    EOL) and Xenial Mitaka.

    Change-Id: Ice5690e7f06ffc78dd20b53b67dffc6bd72b2613
    Closes-Bug: 1738063
    (cherry picked from commit a256263c79236be8adc0ea5176c0e4512c5a135b)

James Page (james-page)
Changed in charm-swift-proxy:
status: Fix Committed → Fix Released
Revision history for this message
Corey Bryant (corey.bryant) wrote :

Hi Edward,

I've backported the following to corresponding cloud archive proposed pockets for testing:

newton: swift-plugin-s3 1.10-3~cloud0
ocata: swift-plugin-s3 1.11-2~cloud0
pike: swift-plugin-s3 1.11-2~cloud0

Thanks,
Corey

Revision history for this message
Edward Hope-Morley (hopem) wrote :

@corey.bryant thanks I will test those today. Don't forget that we also need to make Trusty Mitaka UCA parity with Xenial (which has 1.10-1)

Revision history for this message
Edward Hope-Morley (hopem) wrote :

@corey.bryant actually I see in http://reqorts.qa.ubuntu.com/reports/ubuntu-server/cloud-archive/mitaka_versions.html that 1.10-1~cloud0 was uploaded but it failed to build (and weirdly is reported as existing in -proposed even though it is not). I also note that the N/O/P builds are are in -staging but not -proposed.

Revision history for this message
Corey Bryant (corey.bryant) wrote :

There was a hash mismatch in the cloud archive with ocata and pike having the same versions. That's been fixed and the packages are now syncing to proposed.

I need to look into the build failure for Mitaka.

Revision history for this message
Corey Bryant (corey.bryant) wrote :

swift-plugin-s3 1.10-1~cloud1 is available now in mitaka-proposed.

Edward Hope-Morley (hopem)
tags: added: sts-sru-needed
Revision history for this message
Corey Bryant (corey.bryant) wrote :

Newton is end of life.

Edward Hope-Morley (hopem)
tags: removed: sts-sru-needed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.