[CI][CS8][Master] Overcloud node provision failed: Timeout reached while waiting for callback

Bug #1959914 reported by Dariusz Smigiel
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Unassigned

Bug Description

Job "periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-network-master" [1] started failing during "openstack overcloud node provision" when running "ovb.yml" [3] on 2022-01-22 12:22:10
The job has been continuously failing for last few days with exact same error.

2022-02-02 14:16:53.663333 | fa163e79-4805-cf4e-cab5-000000000018 | FATAL | Provision instances | localhost | error={"changed": false, "logging": "Created port overcloud-controller-1-ctlplane (UUID a842452d-c859-4c43-83ad-075415dfe79f) for node baremetal-12059-0 (UUID 3444e52b-15e0-4003-8344-52416fc7d3fa) with {'network_id': 'b80e5ddb-8f42-487a-be78-a2bdff7116d7', 'name': 'overcloud-controller-1-ctlplane'}\nCreated port overcloud-novacompute-0-ctlplane (UUID c60d3b5b-18ef-4f8a-9b38-21aed84db3d0) for node baremetal-12059-3 (UUID 6d112eed-c1d9-428f-92c8-d772b07ad504) with {'network_id': 'b80e5ddb-8f42-487a-be78-a2bdff7116d7', 'name': 'overcloud-novacompute-0-ctlplane'}\nCreated port overcloud-controller-2-ctlplane (UUID 2f46c395-c63d-49e7-a076-193b955bf96a) for node baremetal-12059-1 (UUID c8b7cd9d-d049-498d-904d-f3422a245e10) with {'network_id': 'b80e5ddb-8f42-487a-be78-a2bdff7116d7', 'name': 'overcloud-controller-2-ctlplane'}\nCreated port overcloud-controller-0-ctlplane (UUID aa3f1815-f8ea-441b-abb1-ba9187bb8320) for node baremetal-12059-2 (UUID 8b6ec837-5a23-4a27-905f-c4b6a7982a61) with {'network_id': 'b80e5ddb-8f42-487a-be78-a2bdff7116d7', 'name': 'overcloud-controller-0-ctlplane'}\nAttached port overcloud-controller-1-ctlplane (UUID a842452d-c859-4c43-83ad-075415dfe79f) to node baremetal-12059-0 (UUID 3444e52b-15e0-4003-8344-52416fc7d3fa)\nAttached port overcloud-controller-2-ctlplane (UUID 2f46c395-c63d-49e7-a076-193b955bf96a) to node baremetal-12059-1 (UUID c8b7cd9d-d049-498d-904d-f3422a245e10)\nAttached port overcloud-novacompute-0-ctlplane (UUID c60d3b5b-18ef-4f8a-9b38-21aed84db3d0) to node baremetal-12059-3 (UUID 6d112eed-c1d9-428f-92c8-d772b07ad504)\nAttached port overcloud-controller-0-ctlplane (UUID aa3f1815-f8ea-441b-abb1-ba9187bb8320) to node baremetal-12059-2 (UUID 8b6ec837-5a23-4a27-905f-c4b6a7982a61)\nProvisioning started on node baremetal-12059-0 (UUID 3444e52b-15e0-4003-8344-52416fc7d3fa)\nProvisioning started on node baremetal-12059-2 (UUID 8b6ec837-5a23-4a27-905f-c4b6a7982a61)\nProvisioning started on node baremetal-12059-3 (UUID 6d112eed-c1d9-428f-92c8-d772b07ad504)\nProvisioning started on node baremetal-12059-1 (UUID c8b7cd9d-d049-498d-904d-f3422a245e10)\n", "msg": "Node 6d112eed-c1d9-428f-92c8-d772b07ad504 reached failure state \"deploy failed\"; the last error is Timeout reached while waiting for callback for node 6d112eed-c1d9-428f-92c8-d772b07ad504"}
2022-02-02 14:16:53.670451 | fa163e79-4805-cf4e-cab5-000000000018 | TIMING | Provision instances | localhost | 0:34:50.240156 | 2076.88s

[1]: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-network-master
[2]: https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-network-master/eb2bdad/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz
[3]: https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-network-master/eb2bdad/job-output.txt

Changed in tripleo:
status: New → Triaged
importance: Undecided → Critical
milestone: none → yoga-2
description: updated
Ronelle Landy (rlandy)
tags: added: promotion-blocker
Revision history for this message
Ronelle Landy (rlandy) wrote :

Closing out - we don't see this lately

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.