tripleo

openstack-nova-compute container build failed in cs9 content-provider job

Bug #2001626 reported by Amol Kahat
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Bogdan Dobrelya
tripleo antelope-1

Bug Description

Description
-----------
Content provider jobs failed on building containers.

Actual Error
------------
STEP 8/8: RUN jq ".mapping[\"nvram-template\"] = $(jq ".mapping[\"nvram-template\"]" /usr/share/qemu/firmware/50-edk2-ovmf-cc.json)" /usr/share/qemu/firmware/50-edk2-ovmf-amdsev.json > /tmp/50-edk2-ovmf-amdsev_.json && mv -f /tmp/50-edk2-ovmf-amdsev_.json /usr/share/qemu/firmware/50-edk2-ovmf-amdsev.json
jq: error: Could not open file /usr/share/qemu/firmware/50-edk2-ovmf-cc.json: No such file or directory
jq: error: syntax error, unexpected end of file (Unix shell quoting issues?) at <top-level>, line 1:
.mapping["nvram-template"] =
jq: 1 compile error

- https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_40f/867336/3/check/tripleo-ci-centos-9-content-provider/40f024b/logs/container-builds/7c2352ae-57a3-43f2-80d8-d042ec033980/base/os/nova-base/nova-libvirt/nova-libvirt-build.log

Logs
----
- https://da9d91664a6ebb1d0cda-7e513b902e81eb926eb2654dfc72839e.ssl.cf5.rackcdn.com/869121/1/check/tripleo-ci-centos-9-content-provider/dd300fa/job-output.txt
- https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_40f/867336/3/check/tripleo-ci-centos-9-content-provider/40f024b/job-output.txt
- https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b8a/869099/6/check/tripleo-ci-centos-9-content-provider/b8aac01/job-output.txt
- https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_289/866581/17/check/tripleo-ci-centos-9-content-provider/289c107/job-output.txt
- https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_21f/869149/1/check/tripleo-ci-centos-9-content-provider/21ffaf8/job-output.txt
- https://a956625abcec4d59cb89-0be94717999cd15feb83d1b45ea82dbe.ssl.cf2.rackcdn.com/866864/25/check/tripleo-ci-centos-9-content-provider/9955f12/job-output.txt

This issue is seen in check line. It's not in the gate yet.

RPM versions
------------
Installed version in failed job
- qemu-img.x86_64 17:7.2.0-2.el9 @quickstart-centos-appstreams

Installed version in Passed job
- qemu-img.x86_64 17:7.1.0-6.el9 @quickstart-centos-appstreams

Bogdan Dobrelya (bogdando)
Changed in tripleo:
status: Confirmed → In Progress
assignee: nobody → Bogdan Dobrelya (bogdando)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-common (master)

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-common/+/869206

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to tripleo-common (stable/zed)

Fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/tripleo-common/+/869207

Revision history for this message
Amol Kahat (amolkahat) wrote :

Other observation, syntax error in libvirt-base logs[1]
Bash script expression is not valid expression[2].

[1] https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b8a/869099/6/check/tripleo-ci-centos-9-content-provider/b8aac01/logs/container-builds/199d6d1a-c27e-4bfc-a8b4-08e9ab17d69d/base/os/nova-base/nova-compute/nova-compute-build.log

[2] https://opendev.org/openstack/tripleo-common/src/branch/master/container-images/kolla/base/uid_gid_manage.sh#L119

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-common/+/869208

Amol Kahat (amolkahat)
tags: added: promotion-blocker
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-common/+/869240

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on tripleo-common (master)

Change abandoned by "Cedric Jeanneret <email address hidden>" on branch: master
Review: https://review.opendev.org/c/openstack/tripleo-common/+/869240
Reason: Won't do anything since content-provider for master is also broken at this point. We must amend the actual fix to remove the upgrades jobs, and do a partial revert once the fix is in stable/Zed.

Revision history for this message
Amol Kahat (amolkahat) wrote :

This is also affecting periodic-tripleo-ci-build-containers-ubi-9-quay-push-zed[1][2]

[1] https://logserver.rdoproject.org/openstack-periodic-integration-zed-centos9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-9-quay-push-zed/6419f10/logs/build.log
[2] https://logserver.rdoproject.org/openstack-periodic-integration-zed-centos9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-ubi-9-quay-push-zed/a685002/logs/build.log

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-common (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/869206
Committed: https://opendev.org/openstack/tripleo-common/commit/6c8fccb88802c40fa495bce0bf70e73ad4fb8311
Submitter: "Zuul (22348)"
Branch: master

commit 6c8fccb88802c40fa495bce0bf70e73ad4fb8311
Author: Bogdan Dobrelya <email address hidden>
Date: Wed Jan 4 13:39:25 2023 +0100

    Fix missing 50-edk2-ovmf-*.json files handling

    Follow-up Ieaacb67d16e82e9c34fcfb31398da5a95cdc3d43
    Add missing tests for /usr/share/qemu/firmware/50-edk2-ovmf-*.json

    Note: it also comment out the upgrades jobs in order to not fail on Zed
    line which is also affected.

    Related: rhbz#2090752
    Related: rhbz#2109644
    Closes-bug: #2001626

    Change-Id: I540c681687f5502aaa2e0b9d8b81b5fef83b2bc2
    Co-Authored-By: Cedric Jeanneret <email address hidden>
    Signed-off-by: Bogdan Dobrelya <email address hidden>

Changed in tripleo:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/869208
Committed: https://opendev.org/openstack/tripleo-common/commit/d2dc6e4cdae515e6a5bee4e5c9cfb7f57c417d5a
Submitter: "Zuul (22348)"
Branch: master

commit d2dc6e4cdae515e6a5bee4e5c9cfb7f57c417d5a
Author: Amol Kahat <email address hidden>
Date: Wed Jan 4 18:22:56 2023 +0530

    Fix syntax error in uid_gid_manage.sh file

    Related-Bug: #2001626

    Signed-off-by: Amol Kahat <email address hidden>
    Change-Id: I53fa23723db0a334b2afb58e0a381439ac535a74

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tripleo-common (stable/zed)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/869207
Committed: https://opendev.org/openstack/tripleo-common/commit/299fc4a8216d59b10bfec230b2f6a5568e660d42
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 299fc4a8216d59b10bfec230b2f6a5568e660d42
Author: Bogdan Dobrelya <email address hidden>
Date: Wed Jan 4 13:39:25 2023 +0100

    Fix missing 50-edk2-ovmf-*.json files handling

    Follow-up Ieaacb67d16e82e9c34fcfb31398da5a95cdc3d43
    Add missing tests for /usr/share/qemu/firmware/50-edk2-ovmf-*.json.

    Related: rhbz#2090752
    Related: rhbz#2109644
    Closes-bug: #2001626

    Change-Id: I540c681687f5502aaa2e0b9d8b81b5fef83b2bc2
    Signed-off-by: Bogdan Dobrelya <email address hidden>
    (cherry picked from commit 0ad8979cb40b978b736e8391463e627ac893eba9)

tags: added: in-stable-zed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/869242
Committed: https://opendev.org/openstack/tripleo-common/commit/a33fdd44d075a152d703d1388e410d1b297ee983
Submitter: "Zuul (22348)"
Branch: master

commit a33fdd44d075a152d703d1388e410d1b297ee983
Author: Cédric Jeanneret <email address hidden>
Date: Wed Jan 4 18:06:11 2023 +0100

    Re-enable upgrades jobs following content-provider fix

    Following I540c681687f5502aaa2e0b9d8b81b5fef83b2bc2 merge in stable/Zed,
    we can now re-add the upgrades jobs.

    Depends-On: https://review.opendev.org/c/openstack/tripleo-common/+/869207
    Related-Bug: #2001626
    Change-Id: Ia78c7be40a7bc9ff392a1286b3d6de7a82c47bb9

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-common (stable/zed)

Related fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/tripleo-common/+/869327

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-common (stable/zed)

Reviewed: https://review.opendev.org/c/openstack/tripleo-common/+/869327
Committed: https://opendev.org/openstack/tripleo-common/commit/3f4e72fbb05772686bd76af77f5de33e6b2ddaac
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 3f4e72fbb05772686bd76af77f5de33e6b2ddaac
Author: Amol Kahat <email address hidden>
Date: Wed Jan 4 18:22:56 2023 +0530

    Fix syntax error in uid_gid_manage.sh file

    Related-Bug: #2001626

    Signed-off-by: Amol Kahat <email address hidden>
    Change-Id: I53fa23723db0a334b2afb58e0a381439ac535a74
    (cherry picked from commit d2dc6e4cdae515e6a5bee4e5c9cfb7f57c417d5a)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.