Flaky test: TestClusterClient - test_registerRackWithRegion_end_to_end

http://maas-ci.internal:8080/job/maas-tester/748/consoleText

[2022-09-23T13:24:50.727Z] ======================================================================
[2022-09-23T13:24:50.727Z] FAIL: provisioningserver.rpc.tests.test_clusterservice.TestClusterClient.test_registerRackWithRegion_end_to_end
[2022-09-23T13:24:50.727Z] provisioningserver.rpc.tests.test_clusterservice.TestClusterClient.test_registerRackWithRegion_end_to_end
[2022-09-23T13:24:50.727Z] ----------------------------------------------------------------------
[2022-09-23T13:24:50.727Z] testtools.testresult.real._StringException: testtools.testresult.real._StringException: Seeds: {{{MAAS_RAND_SEED=f7f8b96b10ed07fd PYTHONHASHSEED=2740712418}}}
[2022-09-23T13:24:50.727Z] Twisted logs: {{{Failed to contact region. (While requesting RPC info at http://netloc-9qeatk.example.com:35264/path-Zr2X6M).RegionFactory starting on '/tmp/tmpqggepv25/1'Starting factory <provisioningserver.rpc.testing.MockLiveClusterToRegionRPCFixture.connect.<locals>.RegionFactory object at 0x7fd6fce446d0>Starting factory <twisted.internet.endpoints.connectProtocol.<locals>.OneShotFactory object at 0x7fd6fc4cbca0>ClusterClient connection established (HOST:UNIXAddress(None) PEER:UNIXAddress('/tmp/tmpqggepv25/1'))[RPC -> sent] AmpBox({b'message': b'\xf9\x8ba5\x9d\xae\x8dcWh|=k\r\xa5%', b'_command': b'Authenticate', b'_ask': b'1'})AMPTestProtocol#8 connection established (HOST:UNIXAddress('/tmp/tmpqggepv25/1') PEER:UNIXAddress(None))[RPC <- received] AmpBox({b'_ask': b'1', b'_command': b'Authenticate', b'message': b'\xf9\x8ba5\x9d\xae\x8dcWh|=k\r\xa5%'})[RPC -> responding] AmpBox({b'digest': b'\xa4RH\xaboR\x03Dt\x08\xc2\xbc\x83\xfa\x07\x11_+\xf9\xbc\xb6)}T\x1d%2\xf4\x81\x97c\xe5', b'salt': b'\xe9\x1c-#\x14dp\xc9\x8da\x05\x089l\xfc\x11', b'_answer': b'1'})[RPC <- recieved] AmpBox({b'_answer': b'1', b'digest': b'\xa4RH\xaboR\x03Dt\x08\xc2\xbc\x83\xfa\x07\x11_+\xf9\xbc\xb6)}T\x1d%2\xf4\x81\x97c\xe5', b'salt': b'\xe9\x1c-#\x14dp\xc9\x8da\x05\x089l\xfc\x11'})Event-loop 'eventloop-xp10th' authenticated.[RPC -> sent] AmpBox({b'system_id': b'maas-id-H9QEAt', b'hostname': b'rackcontrol.example.com', b'interfaces': b'x\x9c\xab\xae\x05\x00\x01u\x00\xf9', b'url': b'http://netloc-9qeatk.example.com:35264/path-Zr2X6M', b'beacon_support': b'True', b'version': b'3.3.0~alpha1-12655-g.977b14110', b'_command': b'RegisterRackController', b'_ask': b'2'})[RPC <- received] AmpBox({b'_ask': b'2', b'_command': b'RegisterRackController', b'beacon_support': b'True', b'hostname': b'rackcontrol.example.com', b'interfaces': b'x\x9c\xab\xae\x05\x00\x01u\x00\xf9', b'system_id': b'maas-id-H9QEAt', b'url': b'http://netloc-9qeatk.example.com:35264/path-Zr2X6M', b'version': b'3.3.0~alpha1-12655-g.977b14110'})[RPC -> responding] AmpBox({b'system_id': b'', b'_answer': b'2'})[RPC <- recieved] AmpBox({b'_answer': b'2', b'system_id': b''})Rack controller '' registered (via eventloop-xp10th) with MAAS version 2.2 or below.(UNIX Port /tmp/tmpqggepv25/1 Closed)Stopping factory <provisioningserver.rpc.testing.MockLiveClusterToRegionRPCFixture.connect.<locals>.RegionFactory object at 0x7fd6fce446d0>AMPTestProtocol#8 connection lost (HOST:UNIXAddress('/tmp/tmpqggepv25/1') PEER:UNIXAddress(None))ClusterClient connection lost (HOST:UNIXAddress(None) PEER:UNIXAddress('/tmp/tmpqggepv25/1'))}}}
[2022-09-23T13:24:50.727Z] twisted-log: {{{
[2022-09-23T13:24:50.727Z] 2022-09-23 13:11:21+0000 [-] Stopping factory <twisted.internet.endpoints.connectProtocol.<locals>.OneShotFactory object at 0x7fd6fc4cbca0>
[2022-09-23T13:24:50.727Z] 2022-09-23 13:11:21+0000 [-] Main loop terminated.
[2022-09-23T13:24:50.727Z] }}}
[2022-09-23T13:24:50.727Z]
[2022-09-23T13:24:50.727Z] Traceback (most recent call last):
[2022-09-23T13:24:50.727Z] File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1660, in _inlineCallbacks
[2022-09-23T13:24:50.727Z] result = current_context.run(gen.send, result)
[2022-09-23T13:24:50.727Z] StopIteration: True
[2022-09-23T13:24:50.727Z]
[2022-09-23T13:24:50.727Z] During handling of the above exception, another exception occurred:
[2022-09-23T13:24:50.727Z]
[2022-09-23T13:24:50.727Z] Traceback (most recent call last):
[2022-09-23T13:24:50.727Z] File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1660, in _inlineCallbacks
[2022-09-23T13:24:50.727Z] result = current_context.run(gen.send, result)
[2022-09-23T13:24:50.727Z] File "/run/build/checkout/src/provisioningserver/rpc/testing/__init__.py", line 429, in connect
[2022-09-23T13:24:50.727Z] returnValue(shutdown)
[2022-09-23T13:24:50.727Z] File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1594, in returnValue
[2022-09-23T13:24:50.727Z] raise _DefGen_Return(val)
[2022-09-23T13:24:50.727Z] twisted.internet.defer._DefGen_Return: <function MockLiveClusterToRegionRPCFixture.connect.<locals>.shutdown at 0x7fd6f7a9c550>
[2022-09-23T13:24:50.727Z]
[2022-09-23T13:24:50.727Z] During handling of the above exception, another exception occurred:
[2022-09-23T13:24:50.727Z]
[2022-09-23T13:24:50.727Z] Traceback (most recent call last):
[2022-09-23T13:24:50.727Z] File "/usr/lib/python3/dist-packages/twisted/internet/defer.py", line 1660, in _inlineCallbacks
[2022-09-23T13:24:50.727Z] result = current_context.run(gen.send, result)
[2022-09-23T13:24:50.727Z] File "/run/build/checkout/src/provisioningserver/rpc/tests/test_clusterservice.py", line 2079, in test_registerRackWithRegion_end_to_end
[2022-09-23T13:24:50.727Z] self.assertThat(
[2022-09-23T13:24:50.727Z] File "/run/build/checkout/.ve/lib/python3.10/site-packages/testtools/testcase.py", line 480, in assertThat
[2022-09-23T13:24:50.727Z] raise mismatch_error
[2022-09-23T13:24:50.727Z] testtools.matchers._impl.MismatchError: expected call not found.
[2022-09-23T13:24:50.727Z] Expected: RegisterRackController(<AMPTestProtocol#8 at 0x7fd6f7a768f0>, system_id='', hostname='rackcontrol.example.com', interfaces={}, url=ParseResult(scheme='http', netloc='netloc-9qeatk.example.com:35264', path='/path-Zr2X6M', params='', query='', fragment=''), nodegroup_uuid=None, beacon_support=True, version='3.3.0~alpha1-12655-g.977b14110')
[2022-09-23T13:24:50.727Z] Actual: RegisterRackController(<AMPTestProtocol#8 at 0x7fd6f7a768f0>, system_id='maas-id-H9QEAt', hostname='rackcontrol.example.com', interfaces={}, url=ParseResult(scheme='http', netloc='netloc-9qeatk.example.com:35264', path='/path-Zr2X6M', params='', query='', fragment=''), nodegroup_uuid=None, beacon_support=True, version='3.3.0~alpha1-12655-g.977b14110')