KeyError: 'result'

Bug #1218117 reported by Robert Bruce Park
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
unity-webapps-qml
New
Critical
Alexandre Abreu

Bug Description

Some recent test failures blocking quanternourly release:

http://10.97.0.1:8080/job/autopilot-saucy-daily_release/1364/label=qa-nvidia-gtx660/testReport/junit/unity_webapps_qml.tests.test_injectedOnWebapp/UnityWebappsApiInjectedTestCaseBase/test_getUnityObjectFound/

This blocks releasing of the webapps stack, and also automatic releasing of the apps stack.

_StringException: Empty attachments:
  process-stdout
  unity-log

process-return-code: {{{-15}}}
process-stderr: {{{
Loading testability driver.
Ignoring argument: "/usr/bin/unity-webapps-qml-launcher"
Ignoring argument: "-testability"
Adding property: "url" , value: "file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_api_injected.html"
Adding property: "webappName" , value: "unitywebappsqmllauncher"

WARNING: This project is using the experimental QML API extensions for QtWebKit and is therefore tied to a specific QtWebKit release.
WARNING: The experimental API will change from version to version, or even be removed. You have been warned!

Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-amazon/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-amazon"
Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-deezer/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-deezer"
Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplus/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplus"
Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplusgames/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplusgames"
onLoadingChanged: loading changed: file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_api_injected.html, status: 0
onLoadingChanged: loading changed: file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_api_injected.html, status: 2
Now watching for emissions of the "resultUpdated(QString)" signal on object with id 3
Signal emissions 0 QObject(0x9e442f8)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Signal emissions 0 QObject(0x9e442f8)
Reply sent.
Result: undefined
Signal emissions 1 QObject(0x9e442f8)
Reply sent.
Signal emissions 1 QObject(0x9e442f8)
Reply sent.
}}}

test-log: {{{
22:30:40.852 INFO globals:49 - ************************************************************
22:30:40.852 INFO globals:50 - Starting test unity_webapps_qml.tests.test_injectedOnWebapp.UnityWebappsApiInjectedTestCaseBase.test_getUnityObjectFound
22:30:40.853 DEBUG globals:148 - Starting: ['/usr/bin/recordmydesktop', '--fps=6', '--no-wm-check', '--no-sound', '--no-frame', '-o', '/var/local/autopilot//videos/unity_webapps_qml.tests.test_injectedOnWebapp.UnityWebappsApiInjectedTestCaseBase.test_getUnityObjectFound.ogv']
22:30:40.874 INFO __init__:156 - Launching process: ['/usr/bin/unity-webapps-qml-launcher', '-testability', '--qml=/usr/share/unity-webapps-qml/autopilot-tests/qml/FullWebViewApp.qml', '--url=file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_api_injected.html', '--app-id=unitywebappsqmllauncher', '--webappName=unitywebappsqmllauncher']
22:30:41.082 INFO __init__:400 - dbus.DBusException while attempting to get PID for org.freedesktop.DBus: DBusException("Could not get PID of name 'org.freedesktop.DBus': no such name",)
22:30:43.127 ERROR proxies:410 - Introspect error on :1.122:/com/canonical/Autopilot/Introspection: dbus.exceptions.DBusException: org.freedesktop.DBus.Error.UnknownObject: No such object path '/com/canonical/Autopilot/Introspection'
22:30:43.128 DEBUG proxies:413 - Executing introspect queue due to error
22:30:43.183 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webview'}
22:30:43.229 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:43.238 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:44.263 INFO testcase:443 - waiting for process to exit.
22:30:45.266 INFO __init__:89 - Checking system state for badly behaving test...
22:30:45.367 INFO __init__:152 - Test was well behaved.
}}}

Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/unity_webapps_qml/tests/test_injectedOnWebapp.py", line 33, in test_getUnityObjectFound
    self.assertThat(lambda: self.eval_expression_in_page_unsafe('return window.external.getUnityObject(1.0) != null;'), Eventually(NotEquals(None)))
  File "/usr/lib/python2.7/dist-packages/testtools/testcase.py", line 406, in assertThat
    mismatch = matcher.match(matchee)
  File "/usr/lib/python2.7/dist-packages/autopilot/matchers/__init__.py", line 109, in match
    wait_fun(self.matcher, self.timeout)
  File "/usr/lib/python2.7/dist-packages/autopilot/matchers/__init__.py", line 125, in _callable_wait_for
    new_value = refresh_fn()
  File "/usr/lib/python2.7/dist-packages/unity_webapps_qml/tests/test_injectedOnWebapp.py", line 33, in <lambda>
    self.assertThat(lambda: self.eval_expression_in_page_unsafe('return window.external.getUnityObject(1.0) != null;'), Eventually(NotEquals(None)))
  File "/usr/lib/python2.7/dist-packages/unity_webapps_qml/tests/__init__.py", line 101, in eval_expression_in_page_unsafe
    return json.loads(webview.get_signal_emissions('resultUpdated(QString)')[-1][0])['result']
KeyError: 'result'

http://10.97.0.1:8080/job/autopilot-saucy-daily_release/1364/label=qa-nvidia-gtx660/testReport/junit/unity_webapps_qml.tests.test_hud/UnityWebappsHudTestCase/test_addAction/

_StringException: Empty attachments:
  process-stdout
  unity-log

process-return-code: {{{-15}}}
process-stderr: {{{
Loading testability driver.
Ignoring argument: "/usr/bin/unity-webapps-qml-launcher"
Ignoring argument: "-testability"
Adding property: "url" , value: "file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_hud.html"
Adding property: "webappName" , value: "unitywebappsqmllauncher"

WARNING: This project is using the experimental QML API extensions for QtWebKit and is therefore tied to a specific QtWebKit release.
WARNING: The experimental API will change from version to version, or even be removed. You have been warned!

Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-amazon/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-amazon"
Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-deezer/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-deezer"
Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplus/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplus"
Could not open manifest file: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplusgames/manifest.json"
Invalid webapps installation found: "/usr/share/unity-webapps/userscripts/unity-webapps-googleplusgames"
onLoadingChanged: loading changed: file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_hud.html, status: 0
onLoadingChanged: loading changed: file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_hud.html, status: 2
Now watching for emissions of the "resultUpdated(QString)" signal on object with id 3
Signal emissions 0 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 1 QObject(0x8f3b280)
Reply sent.
Signal emissions 1 QObject(0x8f3b280)
Reply sent.
Signal emissions 1 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 2 QObject(0x8f3b280)
Reply sent.
Signal emissions 2 QObject(0x8f3b280)
Reply sent.
Signal emissions 2 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 3 QObject(0x8f3b280)
Reply sent.
Signal emissions 3 QObject(0x8f3b280)
Reply sent.
Signal emissions 3 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 4 QObject(0x8f3b280)
Reply sent.
Signal emissions 4 QObject(0x8f3b280)
Reply sent.
Signal emissions 4 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 5 QObject(0x8f3b280)
Reply sent.
Signal emissions 5 QObject(0x8f3b280)
Reply sent.
Signal emissions 5 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 6 QObject(0x8f3b280)
Reply sent.
Signal emissions 6 QObject(0x8f3b280)
Reply sent.
Signal emissions 6 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 7 QObject(0x8f3b280)
Reply sent.
Signal emissions 7 QObject(0x8f3b280)
Reply sent.
Signal emissions 7 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 8 QObject(0x8f3b280)
Reply sent.
Signal emissions 8 QObject(0x8f3b280)
Reply sent.
Signal emissions 8 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 9 QObject(0x8f3b280)
Reply sent.
Signal emissions 9 QObject(0x8f3b280)
Reply sent.
Signal emissions 9 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 10 QObject(0x8f3b280)
Reply sent.
Signal emissions 10 QObject(0x8f3b280)
Reply sent.
Signal emissions 10 QObject(0x8f3b280)
Reply sent.
Method parameter names: ("expr")
Method parameter types: ("QVariant")
Method signature: "evalInPageUnsafe(QVariant)" return type: QVariant
Method Invoked.
Result:
Signal emissions 11 QObject(0x8f3b280)
Reply sent.
Signal emissions 11 QObject(0x8f3b280)
Reply sent.
}}}

test-log: {{{
22:30:47.277 INFO globals:49 - ************************************************************
22:30:47.277 INFO globals:50 - Starting test unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_addAction
22:30:47.278 DEBUG globals:148 - Starting: ['/usr/bin/recordmydesktop', '--fps=6', '--no-wm-check', '--no-sound', '--no-frame', '-o', '/var/local/autopilot//videos/unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_addAction.ogv']
22:30:47.303 INFO __init__:156 - Launching process: ['/usr/bin/unity-webapps-qml-launcher', '-testability', '--qml=/usr/share/unity-webapps-qml/autopilot-tests/qml/FullWebViewApp.qml', '--url=file:///usr/share/unity-webapps-qml/autopilot-tests/html/test_webapps_hud.html', '--app-id=unitywebappsqmllauncher', '--webappName=unitywebappsqmllauncher']
22:30:47.498 INFO __init__:400 - dbus.DBusException while attempting to get PID for org.freedesktop.DBus: DBusException("Could not get PID of name 'org.freedesktop.DBus': no such name",)
22:30:49.616 ERROR proxies:410 - Introspect error on :1.127:/com/canonical/Autopilot/Introspection: dbus.exceptions.DBusException: org.freedesktop.DBus.Error.UnknownObject: No such object path '/com/canonical/Autopilot/Introspection'
22:30:49.617 DEBUG proxies:413 - Executing introspect queue due to error
22:30:49.672 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webview'}
22:30:49.714 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:49.722 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:50.743 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:51.764 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:52.784 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:53.805 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:54.825 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:55.846 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:56.867 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:57.888 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:58.908 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:59.929 DEBUG dbus:391 - Selecting objects of any type with attributes: {'objectName': 'webviewContainer'}
22:30:59.949 INFO testcase:443 - waiting for process to exit.
22:31:00.951 INFO __init__:89 - Checking system state for badly behaving test...
22:31:01.058 INFO __init__:152 - Test was well behaved.
}}}

Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/unity_webapps_qml/tests/test_hud.py", line 34, in test_addAction
    self.assertThat(lambda: self.eval_expression_in_page_unsafe("return document.getElementById('status').innerHTML;"), Eventually(Equals('actionadded')))
MismatchError: After 10.0 seconds test failed: 'actionadded' != u''

Revision history for this message
Timo Jyrinki (timo-jyrinki) wrote :

Confirming with 8 consecutive test runs. Something always fails to run properly, some more often than others:

1:
unity_webapps_qml.tests.test_injectedOnWebapp.UnityWebappsApiInjectedTestCaseBase.test_getUnityObjectFound
unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_addAction

2:
unity_webapps_qml.tests.test_injectedOnWebapp.UnityWebappsApiInjectedTestCaseBase.test_getUnityObjectFound
unity_webapps_qml.tests.test_injectedOnWebapp.UnityWebappsApiInjectedTestCaseBase.test_actionsApiFound
unity_webapps_qml.tests.test_mediaplayer.UnityWebappsMediaplayerTestCase.test_checkInitialSetCanGoNext

3:
unity_webapps_qml.tests.test_injectedOnWebapp.UnityWebappsApiInjectedTestCaseBase.test_getUnityObjectFound

4:
unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_clearAction

5:
unity_webapps_qml.tests.test_launcher.UnityWebappsLauncherTestCase.test_checkProgress
unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_clearActions
unity_webapps_qml.tests.test_mediaplayer.UnityWebappsMediaplayerTestCase.test_checkInitialSetCanGoNext

6:
unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_clearAction
unity_webapps_qml.tests.test_mediaplayer.UnityWebappsMediaplayerTestCase.test_checkInitialSetTrack

7:
unity_webapps_qml.tests.test_launcher.UnityWebappsLauncherTestCase.test_checkProgress
unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_clearActions
unity_webapps_qml.tests.test_mediaplayer.UnityWebappsMediaplayerTestCase.test_checkInitialSetCanPlay

8:
unity_webapps_qml.tests.test_hud.UnityWebappsHudTestCase.test_addAction

description: updated
Revision history for this message
Robert Bruce Park (robru) wrote :

Still getting this; although I noticed that we got green on the intel machine and red on the nvidia machine. That seems really strange to me, like a really tricky race or something.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.