tripleo-ci-centos-9-undercloud-upgrade failing consistently while updating all packages with below traceback :
2022-09-01 07:06:25 | 2022-09-01 07:06:25.280385 | fa163ee2-35df-fd17-55b8-000000000550 | TASK | Update all packages
2022-09-01 07:06:26 | 2022-09-01 07:06:26.573497 | fa163ee2-35df-fd17-55b8-000000000550 | FATAL | Update all packages | undercloud | error={"changed": false, "failures": [], "msg": "Depsolve Error occurred: \n Problem: package os-net-config-15.2.1-0.20220629114404.6505f24.el9.noarch requires NetworkManager-ovs, but none of the providers can be installed\n - package NetworkManager-ovs-1:1.39.10-1.el9.x86_64 requires NetworkManager(x86-64) = 1:1.39.10-1.el9, but none of the providers can be installed\n - package NetworkManager-ovs-1:1.39.12-1.el9.x86_64 requires NetworkManager(x86-64) = 1:1.39.12-1.el9, but none of the providers can be installed\n - package NetworkManager-ovs-1:1.39.6-1.el9.x86_64 requires NetworkManager(x86-64) = 1:1.39.6-1.el9, but none of the providers can be installed\n - package NetworkManager-ovs-1:1.39.7-2.el9.x86_64 requires NetworkManager(x86-64) = 1:1.39.7-2.el9, but none of the providers can be installed\n - package NetworkManager-ovs-1:1.39.90-1.el9.x86_64 requires NetworkManager(x86-64) = 1:1.39.90-1.el9, but none of the providers can be installed\n - cannot install both NetworkManager-1:1.39.10-1.el9.x86_64 and NetworkManager-1:1.40.0-1.el9.x86_64\n - cannot install both NetworkManager-1:1.39.12-1.el9.x86_64 and NetworkManager-1:1.40.0-1.el9.x86_64\n - cannot install both NetworkManager-1:1.39.6-1.el9.x86_64 and NetworkManager-1:1.40.0-1.el9.x86_64\n - cannot install both NetworkManager-1:1.39.7-2.el9.x86_64 and NetworkManager-1:1.40.0-1.el9.x86_64\n - cannot install both NetworkManager-1:1.39.90-1.el9.x86_64 and NetworkManager-1:1.40.0-1.el9.x86_64\n - cannot install the best update candidate for package os-net-config-14.2.1-0.20220624004921.755f151.el9.noarch\n - problem with installed package NetworkManager-1:1.40.0-1.el9.x86_64", "rc": 1, "results": []}
2022-09-01 07:06:26 | 2022-09-01 07:06:26.575110 | fa163ee2-35df-fd17-55b8-000000000550 | TIMING | Update all packages | undercloud | 0:01:08.655448 | 1.29s
Detailed Logs :
https://32f730b73845cbdfd0fc-4cf4bb096d4774f141f32d30757edf40.ssl.cf1.rackcdn.com/853411/2/check/tripleo-ci-centos-9-undercloud-upgrade/b6a6d75/logs/undercloud/home/zuul/undercloud_upgrade.log
https://ef8e3d7fa760b4ab7420-4082203e55009ffc8095c87eb70265ba.ssl.cf5.rackcdn.com/854602/1/gate/tripleo-ci-centos-9-undercloud-upgrade/dc4a2fd/logs/undercloud/home/zuul/undercloud_upgrade.log
<ysandeep> we still have mirror issues: /32f730b73845cb dfd0fc- 4cf4bb096d4774f 141f32d30757edf 40.ssl. cf1.rackcdn. com/853411/ 2/check/ tripleo- ci-centos- 9-undercloud- upgrade/ b6a6d75/ logs/undercloud /var/log/ extra/package- list-installed. txt x86_64 1:1.40.0-1.el9 @baseos libnm.x86_ 64 1:1.40.0-1.el9 @baseos dfw.mirror. rackspace. com/centos- stream/ 9-stream/ AppStream/ x86_64/ os/Packages/ dfw.mirror. rackspace. com/centos- stream/ timestamp. txt mirror. mtl01.iweb. opendev. org/centos- stream/ 9-stream/ AppStream/ x86_64/ os/Packages/ mirror. mtl01.iweb. opendev. org/centos- stream/ timestamp. txt 01T06:08: 45,769043757+ 00:00
<ysandeep> job have .40 version installed
<ysandeep> https:/
<ysandeep> ~~~
<ysandeep> NetworkManager.
<ysandeep> NetworkManager-
<ysandeep> ~~~
<ysandeep> I don't see .40 rpms for NetworkManager on rackspace mirror: http://
<ykarel> facebook mirror looks good
<ykarel> rackspace one not updated since 10 hours
<ykarel> http://
<jm1> ysandeep, ykarel: and neither on http://
<ykarel> yes ^ syncs from mirror which is rax currently so should be same
<ykarel> http://
<ykarel> 2022-09-