Comment 3 for bug 2022949

The InvalidTarget exception was being logged from 02:16 until 02:55, during that same time window can be observed that rabbitmq was dropping connections, although after 02:55 the octavia-worker running in octavia/0 was running until 05:00 which it's the last logged line.

The chunk of rally testin failing has no timestamp, where can I find the associated log?, I would like to correlate with the time window identified.

$ grep oslo_messaging.exceptions.InvalidTarget octavia-worker.log.txt | wc -l
2760
-----------
$ grep oslo_messaging.exceptions.InvalidTarget octavia-worker.log.txt | head -n 2
2023-06-03 02:16:11.771 18362 ERROR cotyledon._utils [-] Unhandled exception: oslo_messaging.exceptions.InvalidTarget: A server's target must have topic and server names specified:<Target server=juju-b68c1b-1-lxd-8>
2023-06-03 02:16:11.771 18362 ERROR cotyledon._utils oslo_messaging.exceptions.InvalidTarget: A server's target must have topic and server names specified:<Target server=juju-b68c1b-1-lxd-8>
$ grep oslo_messaging.exceptions.InvalidTarget octavia-worker.log.txt | tail -n 2
2023-06-03 02:55:37.218 122396 ERROR cotyledon._utils [-] Unhandled exception: oslo_messaging.exceptions.InvalidTarget: A server's target must have topic and server names specified:<Target server=juju-b68c1b-1-lxd-8>
2023-06-03 02:55:37.218 122396 ERROR cotyledon._utils oslo_messaging.exceptions.InvalidTarget: A server's target must have topic and server names specified:<Target server=juju-b68c1b-1-lxd-8>
-----------
$ grep "oslo.messaging._drivers.impl_rabbit" octavia-worker.log.txt | head -n 5
2023-06-03 02:16:11.779 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 1.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:16:12.781 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 3.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:16:15.784 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 5.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:16:20.790 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 7.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:16:27.796 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 9.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
 $ grep "oslo.messaging._drivers.impl_rabbit" octavia-worker.log.txt | tail -n 5
2023-06-03 02:53:33.778 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:54:04.806 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:54:35.834 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:55:06.860 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused
2023-06-03 02:55:37.885 18366 ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 111] Connection refused (retrying in 31.0 seconds): ConnectionRefusedError: [Errno 111] Connection refused