Fuel for OpenStack

[qa] 'run_single_ostf_test' method checks results of all OSTF tests which were performed

Bug #1354300 reported by Artem Panchenko
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Medium
Artem Panchenko
Fuel for OpenStack 5.1
5.0.x
Fix Released
Medium
Artem Panchenko
Fuel for OpenStack 5.0.2

Bug Description

In system tests we use 'run_single_ostf_test' method to run some exact OSTF test and check its results. But after OSTF test is finished that method checks results of all OSTF tests performed for cluster earlier and returns exception in case of failures, for example:

http://jenkins:8080/view/5.0_swarm/job/5.0_fuelmain.system_test.centos.thread_5/60/testReport/%28root%29/ceph_ha_restart/ceph_ha_restart/
https://github.com/stackforge/fuel-main/blob/master/fuelweb_test/tests/tests_strength/test_restart.py#L150

I think we should modify 'assert_ostf_run' method to have ability to checks results of some particular OSTF tests.

Tags: system-tests
Artem Panchenko (apanchenko-8)
Changed in fuel:
importance: High → Medium
Nastya Urlapova (aurlapova)
Changed in fuel:
status: New → Confirmed
Artem Panchenko (apanchenko-8)
Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Artem Panchenko (apanchenko-8)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/116204

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/116204
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=c149d919e7eb3cbc228158175ec6f2cfa8ffd982
Submitter: Jenkins
Branch: master

commit c149d919e7eb3cbc228158175ec6f2cfa8ffd982
Author: Artem Panchenko <email address hidden>
Date: Wed Aug 20 18:55:25 2014 +0300

    Check results of one test in run_single_ostf_test

    In 'run_single_ostf_test' method we run only one health
    check for environment and expect that it will pass. So
    we should verify only its results, because some other OSTF
    tests сould fail earlier.

    Change-Id: Ibb0d38a10fda4f1250b78e7fb61dd66bdc4505d6
    Closes-bug: #1354300

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Andrew Woodward (xarses) wrote :

We appear to have a clean fix to the tests, upping to high so that we can attempt to back port this.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (stable/5.0)

Fix proposed to branch: stable/5.0
Review: https://review.openstack.org/117717

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (stable/5.0)

Reviewed: https://review.openstack.org/117717
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=95e8156e3cda93dafe69c5c05a516c23d7c28ac6
Submitter: Jenkins
Branch: stable/5.0

commit 95e8156e3cda93dafe69c5c05a516c23d7c28ac6
Author: Artem Panchenko <email address hidden>
Date: Wed Aug 20 18:55:25 2014 +0300

    Check results of one test in run_single_ostf_test

    In 'run_single_ostf_test' method we run only one health
    check for environment and expect that it will pass. So
    we should verify only its results, because some other OSTF
    tests could fail earlier.

    Change-Id: Ibb0d38a10fda4f1250b78e7fb61dd66bdc4505d6
    Closes-bug: #1354300
    (cherry picked from commit c149d919e7eb3cbc228158175ec6f2cfa8ffd982)

Artem Panchenko (apanchenko-8)
Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.