tripleo

OVB updates job timing out consistently

Bug #1653735 reported by Ben Nemec
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Emilien Macchi
tripleo ocata-3 "ocata-3"

Bug Description

This appears to have been happing since about the 23rd. Looking at the logs for a failed job it appears as though a puppet run on the compute nodes is hanging during the initial deploy. Since this is the ipv6 job, my shot-in-the-dark guess would be that something merged and broke our ipv6 support, but I have no evidence for that yet. It's also non-trivial to test that because the ssl config in that job is dependent on ipv6 being used.

Revision history for this message
Ben Nemec (bnemec) wrote :

A couple of test patches to narrow down the problem:

-Remove both ssl and ipv6: https://review.openstack.org/416278
-Remove just ssl: https://review.openstack.org/416280

Revision history for this message
Emilien Macchi (emilienm) wrote :

https://review.openstack.org/#/c/409911 broke it:

http://logs.openstack.org/11/409911/9/check-tripleo/gate-tripleo-ci-centos-7-ovb-updates-nv/e9d06e3/logs/overcloud-novacompute-0/var/log/nova/nova-compute.txt.gz#_2016-12-23_16_08_19_533

Changed in tripleo:
milestone: none → ocata-3
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-tripleo (master)

Fix proposed to branch: master
Review: https://review.openstack.org/416305

Changed in tripleo:
assignee: nobody → Ben Nemec (bnemec)
status: Triaged → In Progress
Emilien Macchi (emilienm)
Changed in tripleo:
assignee: Ben Nemec (bnemec) → Carlos Camacho (ccamacho)
Revision history for this message
Ben Nemec (bnemec) wrote :

Unfortunately it doesn't look like the revert worked. We're still investigating.

Note that disabling ipv6+ssl got the job passing, while just disabling ssl didn't, so this is probably ipv6 related in some way.

Ben Nemec (bnemec)
tags: added: networking
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on puppet-tripleo (master)

Change abandoned by Ben Nemec (<email address hidden>) on branch: master
Review: https://review.openstack.org/416305

Revision history for this message
Ben Nemec (bnemec) wrote :

This should be fixed by https://review.openstack.org/#/c/416706 Will close this once that is confirmed.

Emilien Macchi (emilienm)
Changed in tripleo:
assignee: Carlos Camacho (ccamacho) → Emilien Macchi (emilienm)
Emilien Macchi (emilienm)
Changed in tripleo:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.