Fuel for OpenStack

[systest] Test ha mysql termination fail - need to fix check for mysql recovery step

Bug #1339064 reported by Tatyanka
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Medium
Artem Panchenko
Fuel for OpenStack 5.1
5.0.x
Fix Released
Medium
Fuel QA Team
Fuel for OpenStack 5.0.2

Bug Description

http://jenkins-product.srt.mirantis.net:8080/view/5.0_swarm/job/5.0_fuelmain.system_test.centos.thread_5/36/testReport/junit/%28root%29/ha_mysql_termination/ha_mysql_termination/

Test fail here on step check that mysql restarted by timeout. This error caused by wrong verification in test.
We kill there mysqld and mysqld_safe processes and wait until condition len('ps aux | grep "/usr/sbin/mysql"')['stdout']) == 3 will be true, but it will be always false according to:
1. mysqld_d started over /usr/bin/mysqld_safe
2. If we leave grep by mysql we receive next output :
http://paste.openstack.org/show/85673/ - as we can see the len is more then 3

So we shoud fix this verification step in tests and second one user verification over pacemaker for mysql in tests

Tags: system-tests
Tatyanka (tatyana-leontovich)
summary: [system test] Test ha mysql termination fail - need to fix check for
- mysql recovery
+ mysql recovery step
Dmitry Pyzhov (dpyzhov)
no longer affects: fuel/5.1.x
Dmitry Ilyin (idv1985)
summary: - [system test] Test ha mysql termination fail - need to fix check for
- mysql recovery step
+ [systest] Test ha mysql termination fail - need to fix check for mysql
+ recovery step
Revision history for this message
Egor Kotko (ykotko) wrote :

Also affected:
http://jenkins-product.srt.mirantis.net:8080/view/5.0_swarm/job/5.0_fuelmain.system_test.centos.thread_5/54/testReport/%28root%29/ha_haproxy_termination/ha_haproxy_termination/

OpenStack Infra (hudson-openstack)
Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Artem Panchenko (apanchenko-8)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/115568
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=32ce3f59e5f415ad599f387da67a55fe1eac0c08
Submitter: Jenkins
Branch: master

commit 32ce3f59e5f415ad599f387da67a55fe1eac0c08
Author: Artem Panchenko <email address hidden>
Date: Wed Aug 20 12:35:59 2014 +0300

    Fix MySQL termination system test

    Check that MySQL is started by pacemaker after
    forced daemon termination using its PID file and
    resource status command.
    Also fix error in 'wait_mysql_galera_is_up' method:
    it raises an exception "'list' object has no attribute
    'strip'" if execution of remote comand isn't sucessfull

    Change-Id: I7b3d2450c6a5b6c5c19d0a93d80b2e107e452825
    Closes-bug: #1339064

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Andrew Woodward (xarses) wrote :

Seems like we have a good fix for the test failure and should attempt to back port it. pushing to High so that we can keep it open against 5.0.x

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (stable/5.0)

Fix proposed to branch: stable/5.0
Review: https://review.openstack.org/117720

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (stable/5.0)

Reviewed: https://review.openstack.org/117720
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=f013075d01a8ab48a03f70aa86b565ab2a0d07d2
Submitter: Jenkins
Branch: stable/5.0

commit f013075d01a8ab48a03f70aa86b565ab2a0d07d2
Author: Artem Panchenko <email address hidden>
Date: Wed Aug 20 12:35:59 2014 +0300

    Fix MySQL termination system test

    Check that MySQL is started by pacemaker after
    forced daemon termination using its PID file and
    resource status command.
    Also fix error in 'wait_mysql_galera_is_up' method:
    it raises an exception "'list' object has no attribute
    'strip'" if execution of remote command isn't sucessful

    Change-Id: I7b3d2450c6a5b6c5c19d0a93d80b2e107e452825
    Closes-bug: #1339064

Artem Panchenko (apanchenko-8)
Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.