Fuel for OpenStack

System test 'upgrade_ha_env' should add assertions that nodes are online in nailgun after HA cluster upgraded after L130 in test_upgrade.py

Bug #1398825 reported by Dennis Dmitriev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Medium
Andrey Sledzinskiy
Fuel for OpenStack 6.1
5.1.x
Fix Released
Medium
Andrey Sledzinskiy
Fuel for OpenStack 5.1.1-updates
6.0.x
Fix Released
Medium
Andrey Sledzinskiy
Fuel for OpenStack 6.0-updates
6.1.x
Fix Released
Medium
Andrey Sledzinskiy
Fuel for OpenStack 6.1

Bug Description

System test 'upgrade_ha_env' runs OSTF after the cluster upgrade too early:

== http://jenkins-product.srt.mirantis.net:8080/job/5.1_fuelmain.system_test.ubuntu.upgrade/67/
AssertionError: Failed tests, fails: 21

== http://jenkins-product.srt.mirantis.net:8080/job/5.1_fuelmain.system_test.centos.upgrade/66/
AssertionError: Failed tests, fails: 21

Both environment passed OSTF tests after revert.

The test must contain a check for online nodes statuses before ostf run.

See original description
Tags: system-tests
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

Actually in upgrade tests - only master node are upgraded, so pacemaker should be ok, according to we do not run any actions on the clusters here. We need found the reason of failures

Changed in fuel:
status: New → Incomplete
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

So seems nailgun says that all nodes are offline - so that - ostf fail wit such message, we need to add asertion that nodes a online - and then run ostf

summary: - System test 'upgrade_ha_env' should wait until pacemaker be ready after
- HA cluster upgraded
+ System test 'upgrade_ha_env' should add assertions that nodes are online
+ in nailgun after HA cluster upgraded after L130 in test_upgrade.py
Changed in fuel:
status: Incomplete → Confirmed
importance: Undecided → Medium
milestone: 5.1.1 → 5.1.2
description: updated
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/145756

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/145756
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=de1434ba7810e024afb47610a4a2c57dc47d52cb
Submitter: Jenkins
Branch: master

commit de1434ba7810e024afb47610a4a2c57dc47d52cb
Author: asledzinskiy <email address hidden>
Date: Thu Jan 8 13:57:05 2015 +0200

    Add wait for nodes to get online state after upgrade

    - Add wait for nodes to get online state after upgrade
    to prevent OSTF failure

    Change-Id: Ie9714eed49aea7aa6ae06fa9e6285796e070b8fd
    Closes-Bug: #1398825

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (stable/6.0)

Fix proposed to branch: stable/6.0
Review: https://review.openstack.org/145803

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (stable/5.1)

Fix proposed to branch: stable/5.1
Review: https://review.openstack.org/145804

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (stable/6.0)

Reviewed: https://review.openstack.org/145803
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=f1e063891d2a91cf7f4797ad2b6500c3b2fe959f
Submitter: Jenkins
Branch: stable/6.0

commit f1e063891d2a91cf7f4797ad2b6500c3b2fe959f
Author: asledzinskiy <email address hidden>
Date: Thu Jan 8 13:57:05 2015 +0200

    Add wait for nodes to get online state after upgrade

    - Add wait for nodes to get online state after upgrade
    to prevent OSTF failure

    Change-Id: Ie9714eed49aea7aa6ae06fa9e6285796e070b8fd
    Closes-Bug: #1398825
    (cherry picked from commit de1434ba7810e024afb47610a4a2c57dc47d52cb)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (stable/5.1)

Reviewed: https://review.openstack.org/145804
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=b26a23ed0906adde01accb42827dcd954a45a6da
Submitter: Jenkins
Branch: stable/5.1

commit b26a23ed0906adde01accb42827dcd954a45a6da
Author: asledzinskiy <email address hidden>
Date: Thu Jan 8 13:57:05 2015 +0200

    Add wait for nodes to get online state after upgrade

    - Add wait for nodes to get online state after upgrade
    to prevent OSTF failure

    Change-Id: Ie9714eed49aea7aa6ae06fa9e6285796e070b8fd
    Closes-Bug: #1398825
    (cherry picked from commit de1434ba7810e024afb47610a4a2c57dc47d52cb)

Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

check at latest runs

Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.