Substrate runner says PASS when in fact substrate test did not pass
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
charmtester |
Confirmed
|
Medium
|
Unassigned |
Bug Description
Substrate: charm-testing-aws: PASS
Warning: Permanently added '10.0.3.232' (ECDSA) to the list of known hosts.
+ cd /home/ubuntu/
+ juju destroy-environment -y -e charm-testing-aws
WARNING unknown config field "test-mode"
+ '[' -n False ']'
+ failfast=--set-e
+ charm test -v -e charm-testing-aws --set-e --timeout=45m
juju-test INFO : Starting test run on charm-testing-aws using Juju 1.16.6
juju-test DEBUG : Loading configuration options from testplan YAML
juju-test DEBUG : Creating a new Conductor
juju-test.conductor DEBUG : Starting a bootstrap for charm-testing-aws, kill after 300
juju-test.conductor DEBUG : Running the following: juju bootstrap -e charm-testing-aws
WARNING unknown config field "test-mode"
WARNING unknown config field "test-mode"
WARNING unknown config field "test-mode"
juju-test.conductor DEBUG : Waiting for bootstrap
juju-test.conductor DEBUG : Still not bootstrapped
juju-test.conductor DEBUG : Running the following: juju status -e charm-testing-aws
WARNING unknown config field "test-mode"
WARNING unknown config field "test-mode"
juju-test.conductor DEBUG : State for 1.16.6: down
juju-test.conductor DEBUG : Still not bootstrapped
juju-test.conductor DEBUG : Running the following: juju status -e charm-testing-aws
WARNING unknown config field "test-mode"
WARNING unknown config field "test-mode"
juju-test.conductor DEBUG : State for 1.16.6: started
juju-test.
test_write_
=======
ERROR: test_write_
-------
ImportError: Failed to import test module: test_write_
Traceback (most recent call last):
File "/usr/lib/
module = self._get_
File "/usr/lib/
__import_
File "/home/
import mock
ImportError: No module named mock
-------
Ran 1 test in 0.005s
FAILED (errors=1)
juju-test.
juju-test.
juju-test.
juju-test.conductor INFO : Breaking here as requested by --set-e
juju-test INFO : Results: 0 passed, 1 failed, 0 errored
Substrate: charm-testing-aws: should report a fail not a pass for the aws test