stable/grizzly intermittent MetadataRefreshTest failure

Bug #1217829 reported by Steven Hardy
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Heat
Fix Released
High
Zane Bitter
Grizzly
Fix Released
High
Steven Hardy

Bug Description

Intermittent test failures are seen with stable/grizzly:

2013-08-28 06:03:13.634 |
2013-08-28 06:03:13.636 | ======================================================================
2013-08-28 06:03:13.639 | FAIL: test_FnGetAtt (heat.tests.test_metadata_refresh.MetadataRefreshTest)
2013-08-28 06:03:13.642 | ----------------------------------------------------------------------
2013-08-28 06:03:13.643 | Traceback (most recent call last):
2013-08-28 06:03:13.644 | File "/home/jenkins/workspace/periodic-heat-python27-stable-grizzly/heat/tests/utils.py", line 75, in wrapped_test
2013-08-28 06:03:13.644 | test_fn(test_cls)
2013-08-28 06:03:13.644 | File "/home/jenkins/workspace/periodic-heat-python27-stable-grizzly/heat/tests/test_metadata_refresh.py", line 176, in test_FnGetAtt
2013-08-28 06:03:13.644 | self.assertEqual(s2.CREATE_COMPLETE, s2.state)
2013-08-28 06:03:13.645 | AssertionError: 'CREATE_COMPLETE' != 'CREATE_FAILED'
2013-08-28 06:03:13.645 | -------------------- >> begin captured stdout << ---------------------
2013-08-28 06:03:13.645 | Running test test_FnGetAtt
2013-08-28 06:03:13.646 |
2013-08-28 06:03:13.646 | --------------------- >> end captured stdout << ----------------------
2013-08-28 06:03:13.646 | "'CREATE_COMPLETE' != 'CREATE_FAILED'" = '%s != %s' % (safe_repr('CREATE_COMPLETE'), safe_repr('CREATE_FAILED'))
2013-08-28 06:03:13.647 | "'CREATE_COMPLETE' != 'CREATE_FAILED'" = self._formatMessage("'CREATE_COMPLETE' != 'CREATE_FAILED'", "'CREATE_COMPLETE' != 'CREATE_FAILED'")
2013-08-28 06:03:13.647 | >> raise self.failureException("'CREATE_COMPLETE' != 'CREATE_FAILED'")
2013-08-28 06:03:13.647 |
2013-08-28 06:03:13.647 | -------------------- >> begin captured logging << --------------------
2013-08-28 06:03:13.648 | heat.engine.resource: INFO: creating Instance "S1"
2013-08-28 06:03:13.648 | heat.engine.resource: INFO: creating Instance "S2"
2013-08-28 06:03:13.648 | heat.engine.resource: ERROR: create Instance "S2"
2013-08-28 06:03:13.649 | Traceback (most recent call last):
2013-08-28 06:03:13.649 | File "/home/jenkins/workspace/periodic-heat-python27-stable-grizzly/heat/engine/resource.py", line 320, in create
2013-08-28 06:03:13.649 | self.handle_create()
2013-08-28 06:03:13.650 | File "/home/jenkins/workspace/periodic-heat-python27-stable-grizzly/.tox/py27/local/lib/python2.7/site-packages/mox.py", line 765, in __call__
2013-08-28 06:03:13.650 | return mock_method(*params, **named_params)
2013-08-28 06:03:13.650 | File "/home/jenkins/workspace/periodic-heat-python27-stable-grizzly/.tox/py27/local/lib/python2.7/site-packages/mox.py", line 1002, in __call__
2013-08-28 06:03:13.650 | expected_method = self._VerifyMethodCall()
2013-08-28 06:03:13.651 | File "/home/jenkins/workspace/periodic-heat-python27-stable-grizzly/.tox/py27/local/lib/python2.7/site-packages/mox.py", line 1049, in _VerifyMethodCall
2013-08-28 06:03:13.651 | expected = self._PopNextMethod()
2013-08-28 06:03:13.651 | File "/home/jenkins/workspace/periodic-heat-python27-stable-grizzly/.tox/py27/local/lib/python2.7/site-packages/mox.py", line 1035, in _PopNextMethod
2013-08-28 06:03:13.652 | raise UnexpectedMethodCallError(self, None)
2013-08-28 06:03:13.652 | UnexpectedMethodCallError: Unexpected method call handle_create.__call__() -> None
2013-08-28 06:03:13.652 | heat.engine.resource: INFO: deleting Instance "S1" (inst:None db_id:12)
2013-08-28 06:03:13.653 | --------------------- >> end captured logging << ---------------------

Steven Hardy (shardy)
Changed in heat:
status: New → Fix Released
Revision history for this message
Steven Hardy (shardy) wrote :

At first I thought this was fixed by https://review.openstack.org/#/c/31301/ in master, but on closer inspection it seems that is related to parallel create which doesn't exist in grizzly.

It may actually be fixed by:

commit 0f6e437e889f4a8d7b7c197047a380b04803f3c8
Author: Zane Bitter <email address hidden>
Date: Tue Apr 9 20:01:24 2013 +0200

    Clean up metadata refresh unit test

    The stack was not being fully created, because the calls to the mock
    functions were not present for the second instance.

    Change-Id: I894473533eb40133e4c22facbbee749a971cec89

Changed in heat:
status: Fix Released → Invalid
description: updated
Steven Hardy (shardy)
Changed in heat:
status: Invalid → New
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to heat (stable/grizzly)

Fix proposed to branch: stable/grizzly
Review: https://review.openstack.org/44029

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to heat (stable/grizzly)

Reviewed: https://review.openstack.org/44029
Committed: http://github.com/openstack/heat/commit/ef04ede0077dd2af1169f63f0885cf98ac910633
Submitter: Jenkins
Branch: stable/grizzly

commit ef04ede0077dd2af1169f63f0885cf98ac910633
Author: Zane Bitter <email address hidden>
Date: Tue Apr 9 20:01:24 2013 +0200

    Clean up metadata refresh unit test

    The stack was not being fully created, because the calls to the mock
    functions were not present for the second instance.

    Fixes bug #1217829

    (cherry picked from commit 0f6e437e889f4a8d7b7c197047a380b04803f3c8)
    Conflicts:
     heat/tests/test_metadata_refresh.py

    Change-Id: I894473533eb40133e4c22facbbee749a971cec89

Alan Pevec (apevec)
Changed in heat:
assignee: nobody → Zane Bitter (zaneb)
status: New → Fix Committed
importance: Undecided → High
milestone: none → havana-3
Thierry Carrez (ttx)
Changed in heat:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in heat:
milestone: havana-3 → 2013.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.