Master: Overcloud deployment failing on task "FATAL | Ensure system is NTP time synced"

Bug #1975591 reported by Sandeep Yadav
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Sandeep Yadav

Bug Description

Description:

Overcloud deployment failing on task "FATAL | Ensure system is NTP time synced"

log snippet:-

https://logserver.rdoproject.org/57/42657/3/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/8b92185/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz
~~~
2022-05-24 12:56:41 | 2022-05-24 12:56:41.842386 | fa163e8d-0fef-5fc2-1be4-0000000022e8 | FATAL | Ensure system is NTP time synced | overcloud-novacompute-0 | error={"changed": true, "cmd": ["chronyc", "waitsync", "30"], "delta": "0:04:50.279586", "end": "2022-05-24 08:56:42.172652", "msg": "non-zero return code", "rc": 1, "start": "2022-05-24 08:51:51.893066", "stderr": "", "stderr_lines": [], "stdout": "try: 1, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 2, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 3, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 4, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 5, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 6, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 7, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 8, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 9, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 10, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 11, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 12, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 13, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 14, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 15, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 16, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 17, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 18, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 19, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 20, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 21, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 22, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 23, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 24, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 25, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 26, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 27, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 28, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 29, refid: 00000000, correction: 0.000000000, skew: 0.000\ntry: 30, refid: 00000000, correction: 0.000000000, skew: 0.000", "stdout_lines": ["try: 1, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 2, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 3, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 4, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 5, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 6, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 7, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 8, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 9, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 10, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 11, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 12, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 13, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 14, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 15, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 16, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 17, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 18, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 19, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 20, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 21, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 22, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 23, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 24, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 25, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 26, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 27, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 28, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 29, refid: 00000000, correction: 0.000000000, skew: 0.000", "try: 30, refid: 00000000, correction: 0.000000000, skew: 0.000"]}
~~~

More affected jobs:-

https://logserver.rdoproject.org/57/42657/3/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master/d4ad11f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

https://logserver.rdoproject.org/57/42657/3/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/1d82448/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz

Revision history for this message
Sandeep Yadav (sandeepyadav93) wrote :

Reverting the patch which caused this issue at [1]

[1] https://review.opendev.org/c/openstack/python-tripleoclient/+/843196

Changed in tripleo:
status: Triaged → In Progress
assignee: nobody → Sandeep Yadav (sandeepyadav93)
Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
Marios Andreou (marios-b) wrote :

the tripleo/master component is still red on this today (eg [1]) but i think we just need to wait for the next run of periodic-tripleo-centos-9-master-component-tripleo-promote-consistent-to-component-ci-testing

The job is pulling

python-tripleoclient-18.0.1-0.20220524132912.e689a4e.el9.src.rpm

from [2] component-ci-testing but that doesn't have the required fix (d8dabbc66664d9982a8922afc53eb891f49b76bf [3]

but consistent does have it [4]

python-tripleoclient-18.0.1-0.20220527131721.f92535b.el9.src.rpm

is new enough

[1] https://logserver.rdoproject.org/35/43135/6/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-tripleo-master/b59c7f0/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz
[2] https://trunk.rdoproject.org/centos9-master/component/tripleo/component-ci-testing/
[3] https://review.opendev.org/c/openstack/python-tripleoclient/+/843196
[4] https://trunk.rdoproject.org/centos9-master/component/tripleo/consistent/

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.