version tracker tool should pull versions from openstack/releases repo

Bug #1554337 reported by Martin André
16
This bug affects 2 people
Affects Status Importance Assigned to Milestone
kolla
Fix Released
Wishlist
Jeffrey Zhang

Bug Description

Right now it picks the versions from tarballs.openstack.org which has 2 issues:
* if forces us to maintain the major version number for each project
* it parses HTML to find the latest version

We should get the latest versions from https://github.com/openstack/releases instead that provides easily consumable yaml files with all versions per project per release.

Revision history for this message
Rodolfo Alonso (rodolfo-alonso-hernandez) wrote :

Hello Martin. Where exactly in releases.openstack.org can we retrieve the latest versions?

Because in the web page you have a list of releases (OpenStack releases) and then, in each page, a list of project releases (pointing to the tarballs).

Please, can you guide me?

Revision history for this message
Jeff Peeler (jpeeler-z) wrote :

It's under "most recent version" - http://releases.openstack.org/liberty/index.html.

Revision history for this message
Rodolfo Alonso (rodolfo-alonso-hernandez) wrote :

So what you are proposing is to parse the web page? Should be easier to have a text file, or a sql query.

Parsing the content of a web page is not a good solution.

Steven Dake (sdake)
Changed in kolla:
status: New → Triaged
milestone: none → newton-1
Revision history for this message
Jeffrey Zhang (jeffrey4l) wrote :

parse the web page will help us get the latest release version. No other action need be taken.

If we use text file or sql query, where is it come from?

Revision history for this message
Martin André (mandre) wrote :

BTW, scrapping the web page is exactly what we're doing right now. I don't know where else we can get a list of all the latest releases in a format that we can consume easily.

Revision history for this message
Rodolfo Alonso (rodolfo-alonso-hernandez) wrote :

Maybe we can ask people maintaining this web page to generate a json file with this content:
    release:
        project_name: {version: " ", etc: " "}
        project_name2: ...

But, of course, to parse the web page is feasible.

Revision history for this message
Jeffrey Zhang (jeffrey4l) wrote : Re: [Bug 1554337] Re: version tracker tool should pull versions from releases.openstack.org

this script is help use to maintain this kinda of list, now. we can
not do the copy/paste job manually.

On 3/9/16, Rodolfo Alonso <email address hidden> wrote:
> Maybe we can ask people maintaining this web page to generate a json file
> with this content:
> release:
> project_name: {version: " ", etc: " "}
> project_name2: ...
>
> But, of course, to parse the web page is feasible.
>
> --
> You received this bug notification because you are subscribed to the bug
> report.
> https://bugs.launchpad.net/bugs/1554337
>
> Title:
> version tracker tool should pull versions from releases.openstack.org
>
> Status in kolla:
> Triaged
>
> Bug description:
> Right now it picks the versions from tarballs.openstack.org which has 2
> issues:
> * if forces us to maintain the major version number for each project
> * it causes an HTTP query for each project
>
> We should get the latest versions from releases.openstack.org instead.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/kolla/+bug/1554337/+subscriptions
>

--
Jeffrey Zhang
Blog: http://xcodest.me

Revision history for this message
Rodolfo Alonso (rodolfo-alonso-hernandez) wrote : Re: version tracker tool should pull versions from releases.openstack.org

Sorry for being so insistent. I think there is a good place to retrieve all this information:
- This information is daily updated.
- This is the unique source of common information for all projects.
- All information is structured and written in yaml.

https://github.com/openstack/releases
https://github.com/openstack/releases/tree/master/deliverables

What do you think?

Revision history for this message
Jeffrey Zhang (jeffrey4l) wrote :

cool, this is a better place to retrieve version info.

Revision history for this message
Martin André (mandre) wrote :

Rodolpho, please continue to be insistent, that's how we're going to improve things.

I've updated the issue description, thanks for the suggestion.

description: updated
summary: - version tracker tool should pull versions from releases.openstack.org
+ version tracker tool should pull versions from openstack/releases repo
Revision history for this message
Sam Yaple (s8m) wrote :

Hey i didnt see this bug. I have recently merged changes to allow it to dynamically pull projects lists based on what we build in Kolla. This includes looking up the major series number as well.

Is that enough to resolve this bug? https://review.openstack.org/#/c/295057/

Revision history for this message
Jeffrey Zhang (jeffrey4l) wrote :

Sam, this bug tend to use the repo https://github.com/openstack/releases/tree/master/deliverables/mitaka as the source to get the latest version instead of html source.

In this way, it will be faster(just clone a repo is enought, rather than get several html page, which is slow) and stable.

Changed in kolla:
milestone: newton-1 → newton-2
Changed in kolla:
milestone: newton-2 → newton-3
Changed in kolla:
milestone: newton-3 → occata-1
Changed in kolla:
milestone: ocata-1 → ocata-2
Changed in kolla:
milestone: ocata-2 → ocata-3
Changed in kolla:
milestone: ocata-3 → ocata-rc1
Changed in kolla:
milestone: ocata-rc1 → pike-1
assignee: nobody → Jeffrey Zhang (jeffrey4l)
Changed in kolla:
status: Triaged → In Progress
Changed in kolla:
milestone: pike-2 → pike-3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla (master)

Reviewed: https://review.openstack.org/432300
Committed: https://git.openstack.org/cgit/openstack/kolla/commit/?id=ffbc25c1d2f67bbbe80909629f02b0eeb19d5ef5
Submitter: Jenkins
Branch: master

commit ffbc25c1d2f67bbbe80909629f02b0eeb19d5ef5
Author: Jeffrey Zhang <email address hidden>
Date: Fri Feb 10 11:39:14 2017 +0800

    Get OpenStack service versions from openstack/releases repo

    In old implementation, version-check always get the latest versions
    rather than versions for certain release. it is useless for stable
    branch. And it parses from tarballs.openstack.org site, which is
    very slow.

    In this new implementation, version-check gets versions from
    openstack/releases repo, which is faster and accurate. It also support
    get versions for certain OpenStack release. For example, get the Ocata
    latest release version.

    ./verion-check.py --openstack-release ocata

    Closes-Bug: #1554337
    Change-Id: Ie8951625817d82f38cf820cf9bd44ae447e2eb75

Changed in kolla:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla 5.0.0.0b3

This issue was fixed in the openstack/kolla 5.0.0.0b3 development milestone.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.