OSTF cannot pass when the environment has been tested with Rally

Bug #1573717 reported by Andrey Grebennikov
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Artem Minasyan
8.0.x
Fix Committed
High
Artem Minasyan
Mitaka
Fix Released
High
Artem Minasyan
Newton
Fix Committed
High
Artem Minasyan

Bug Description

MOS8, Ceilometer included.

The environment has been created and Rally tests were executed (Ceilometer has lots of data stored in the backend).
OSTF has been started and "Ceilometer test to check events and traits" fails.

fuel_health.common.test_mixins: INFO: STEP:8, verify action: 'getting list of all traits for "compute.instance.update" event type and "instance_id" trait name'
fuel_health.common.test_mixins: INFO: Timeout 60s exceeded for getting list of all traits for "compute.instance.update" event type and "instance_id" trait name

The reason is - OSTF tries to execute the command "ceilometer trait-list -e compute.instance.update -t instance_id", which is supposed to return thousands of traits. Ceilometer API cannot work out that huge amount of data and times out.
Consequently in order to pass the test there is only one way - destroy all the data in Mongo.

I'd suggest to remove this test from the test plan or replace it with some other test including the filtering.

Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

Hi Artem, we need to review the OSTF test and fix the way how we check it, because it looks like our method doesn't work for a cluster with the real workload or cluster after performance testing.

tags: added: area-ceilometer
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-ostf (master)

Fix proposed to branch: master
Review: https://review.openstack.org/309978

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-ostf (master)

Reviewed: https://review.openstack.org/309978
Committed: https://git.openstack.org/cgit/openstack/fuel-ostf/commit/?id=7cec6fbf6ad648cee32b25785e0c864f12552a23
Submitter: Jenkins
Branch: master

commit 7cec6fbf6ad648cee32b25785e0c864f12552a23
Author: Artem <email address hidden>
Date: Mon Apr 25 16:21:21 2016 +0300

    Remove 'trait list' from the method of 'test_check_events_and_traits'

    Option 'ceilometer trait-list' hasn't query and list. When we create
    a lot of VM we get a huge data and trait list cannot retrieve data from MongoDB.

    Change-Id: Ic29450f3875a94b91f90b5b47e6291f70e17e86d
    Closes-bug:#1573717

Changed in fuel:
status: In Progress → Fix Committed
Alex Ermolov (aermolov)
tags: added: non-release
Revision history for this message
Artem Minasyan (aminasyan) wrote :
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.