Comment 1 for bug 1927952

ceph related containers have been pushed into rdo.. however we still have a problem.

2021-05-10 14:45:06.018167 | primary | 127.0.0.1:5001/tripleomaster/openstack-base 22fd7520a99b928db16ffaa8eaee9b63 f3a164bc5eab 40 minutes ago 561 MB
2021-05-10 14:45:06.018193 | primary | registry.access.redhat.com/ubi8 latest 613e5da7a934 3 weeks ago 213 MB
2021-05-10 14:45:06.018221 | primary | trunk.registry.rdoproject.org/ceph/daemon v6.0.0-stable-6.0-pacific-centos-8-x86_64 14fee0875498 5 weeks ago 1.17 GB
2021-05-10 14:45:06.018249 | primary | quay.io/tripleoci/registry 2 2d4f4b5309b1 10 months ago 26.8 MB
2021-05-10 14:45:06.018265 | primary | trunk.registry.rdoproject.org/ceph/grafana 6.7.4 be4c69a1aae8 11 months ago 237 MB
2021-05-10 14:45:06.018278 | primary | trunk.registry.rdoproject.org/ceph/alertmanager v0.16.2 a1c1bd95a2dd 2 years ago 43.9 MB
2021-05-10 14:45:06.018291 | primary | trunk.registry.rdoproject.org/ceph/prometheus v2.7.2 2a68492b2466 2 years ago 103 MB
2021-05-10 14:45:06.018303 | primary | trunk.registry.rdoproject.org/ceph/node-exporter v0.17.0 b3e7f67a1480 2 years ago 22.4 MB
2021-05-10 14:45:06.018315 | primary |
2021-05-10 14:45:06.018328 | primary |
2021-05-10 14:45:06.018341 | primary | STDERR:
2021-05-10 14:45:06.018353 | primary |
2021-05-10 14:45:06.018365 | primary | level=debug msg="[graphdriver] trying provided driver \"overlay\""
2021-05-10 14:45:06.018378 | primary | level=debug msg="cached value indicated that overlay is supported"
2021-05-10 14:45:06.018390 | primary | level=debug msg="cached value indicated that metacopy is being used"
2021-05-10 14:45:06.018402 | primary | level=debug msg="cached value indicated that native-diff is not being used"
2021-05-10 14:45:06.018415 | primary | level=info msg="Not using native diff for overlay, this may cause degraded performance for building images: kernel has CONFIG_OVERLAY_FS_REDIRECT_DIR enabled"
2021-05-10 14:45:06.018428 | primary | level=debug msg="backingFs=extfs, projectQuotaSupported=false, useNativeDiff=false, usingMetacopy=true"
2021-05-10 14:45:06.018440 | primary | level=debug msg="Loading registries configuration \"/etc/containers/registries.conf\""
2021-05-10 14:45:06.018453 | primary | level=debug msg="Loading registries configuration \"/etc/containers/registries.conf.d/000-shortnames.conf\""
2021-05-10 14:45:06.018466 | primary | level=debug msg="Loading registries configuration \"/etc/containers/registries.conf.d/rhel-shortnames.conf\""
2021-05-10 14:45:06.018479 | primary | level=debug msg="registry \"127.0.0.1:5001\" is not listed in registries configuration \"/etc/containers/registries.conf\", assuming it's not blocked"
2021-05-10 14:45:06.018491 | primary | level=debug msg="parsed reference into \"[overlay@/var/lib/containers/storage+/run/containers/storage:overlay.mountopt=nodev,metacopy=on]quay.ceph.io/prometheus/node-exporter:v0.17.0\""
2021-05-10 14:45:06.018505 | primary | level=debug msg="reference \"[overlay@/var/lib/containers/storage+/run/containers/storage:overlay.mountopt=nodev,metacopy=on]quay.ceph.io/prometheus/node-exporter:v0.17.0\" does not resolve to an image ID"
2021-05-10 14:45:06.018525 | primary | level=debug msg="error locating image \"quay.ceph.io/prometheus/node-exporter:v0.17.0\": error locating image with ID \"quay.ceph.io/prometheus/node-exporter:v0.17.0\": image not known"
2021-05-10 14:45:06.018540 | primary | error pushing image "quay.ceph.io/prometheus/node-exporter:v0.17.0" to "docker://127.0.0.1:5001/tripleomaster/node-exporter:v0.17.0": error locating image with name "quay.ceph.io/prometheus/node-exporter:v0.17.0" ([quay.ceph.io/prometheus/node-exporter:v0.17.0]): image not known
2021-05-10 14:45:06.018554 | primary | level=debug msg="shutting down the store"
2021-05-10 14:45:06.018567 | primary | level=info msg="failed to shutdown storage: \"A layer is mounted: layer is in use by a container\""
2021-05-10 14:45:06.018579 | primary |
2021-05-10 14:45:06.018592 | primary |
2021-05-10 14:45:06.018604 | primary | MSG:
2021-05-10 14:45:06.018617 | primary |
2021-05-10 14:45:06.018629 | primary | non-zero return code
2021-05-10 14:45:06.907049 | primary | FAILED - RETRYING: Pull non-tripleo containers (ceph, alertmanager, prometheus) to the content provider registry (3 retries left).
2021-05-10 14:45:12.749587 | primary | FAILED - RETRYING: Pull non-tripleo containers (ceph, alertmanager, prometheus) to the content provider registry (2 retries left).
2021-05-10 14:45:18.624907 | primary | FAILED - RETRYING: Pull non-tripleo containers (ceph, alertmanager, prometheus) to the content provider registry (1 retries left).
2021-05-10 14:45:24.507723 | primary | failed: [undercloud] (item=quay.ceph.io/app-sre/grafana:6.7.4) => {
2021-05-10 14:45:24.507786 | primary | "ansible_loop_var": "item",
2021-05-10 14:45:24.507805 | primary | "attempts": 3,
2021-05-10 14:45:24.507819 | primary | "changed": false,
2021-05-10 14:45:24.507833 | primary | "cmd": "buildah images; buildah push --format=v2s2 --tls-verify=False --log-level debug quay.ceph.io/app-sre/grafana:6.7.4 docker://127.0.0.1:5001/tripleomaster/grafana:6.7.4;\n",
2021-05-10 14:45:24.507847 | primary | "delta": "0:00:00.462100",
2021-05-10 14:45:24.507860 | primary | "end": "2021-05-10 14:45:24.466558",
2021-05-10 14:45:24.507907 | primary | "item": "quay.ceph.io/app-sre/grafana:6.7.4",
2021-05-10 14:45:24.507946 | primary | "rc": 125,
2021-05-10 14:45:24.507969 | primary | "start": "2021-05-10 14:45:24.004458"
2021-05-10 14:45:24.507983 | primary | }