tripleo

[cs8 wallaby][victoria] Unable to discover domain, not provided on command line failing on fs039 and fs064

Bug #1962727 reported by Bhagyashri Shewale
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Unassigned
tripleo yoga-2

Bug Description

2022-03-01 11:36:30.602654 | fa163e99-86ea-8acf-e017-000000000579 | TASK | Install - Set default principal if no keytab is given
2022-03-01 11:36:30.660300 | fa163e99-86ea-8acf-e017-000000000579 | OK | Install - Set default principal if no keytab is given | undercloud
2022-03-01 11:36:30.664137 | fa163e99-86ea-8acf-e017-000000000579 | TIMING | ipaclient : Install - Set default principal if no keytab is given | undercloud | 0:00:39.857126 | 0.06s
2022-03-01 11:36:30.701427 | fa163e99-86ea-8acf-e017-00000000057a | TASK | Install - IPA client test
2022-03-01 11:36:32.309682 | fa163e99-86ea-8acf-e017-00000000057a | FATAL | Install - IPA client test | undercloud | error={"changed": false, "msg": "Unable to discover domain, not provided on command line"}
2022-03-01 11:36:32.311686 | fa163e99-86ea-8acf-e017-00000000057a | TIMING | ipaclient : Install - IPA client test | undercloud | 0:00:41.504768 | 1.61s

PLAY RECAP *********************************************************************
localhost : ok=1 changed=0 unreachable=0 failed=0 skipped=2 rescued=0 ignored=0
undercloud : ok=59 changed=31 unreachable=0 failed=1 skipped=10 rescued=0 ignored=2

Affected jobs:

periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset064-wallaby
periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-wallaby
periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-victoria
periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-ussuri

#links:
[1]: https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset064-wallaby/1bdbf47/logs/undercloud/home/zuul/undercloud_install.log.txt.gz
[2]: https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset064-wallaby/1bdbf47/job-output.txt
[3]: https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-ussuri/ef77d5c/logs/undercloud/home/zuul/undercloud_install.log.txt.gz
[4]: https://logserver.rdoproject.org/openstack-periodic-integration-stable2/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-victoria/c48b479/logs/undercloud/home/zuul/undercloud_install.log.txt.gz

Revision history for this message
Grzegorz Grasza (xek) wrote :

The error comes from https://github.com/freeipa/ansible-freeipa/blob/ef9f7fcb84c716e635ddff7bbc6a24ae96bbc1a0/roles/ipaclient/library/ipaclient_test.py#L682

Revision history for this message
Grzegorz Grasza (xek) wrote :

The undercloud dns points to 1.1.1.1 and 8.8.8.8 instead of the supplemental node

https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset064-wallaby/1bdbf47/logs/undercloud/etc/resolv.conf.txt.gz

Revision history for this message
Grzegorz Grasza (xek) wrote :

tripleo-quickstart-extras/roles/ipa-multinode/tasks/ipaserver-undercloud-setup.yml should set the DNS, but I can't find any logs, so looks to me like it's not run.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to tripleo-quickstart-extras (master)

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/831569

Revision history for this message
Dariusz Smigiel (smigiel-dariusz) wrote (last edit ):

Indeed, some change has been introduced.
Two consecutive test runs on the same day [1] [2] have different results. First passed (2022-02-28 16:26:33), while second failed (2022-02-28 22:21:02).

Working test run uses hash: 4d3f369ef2c0a7325678d3d08ef3101d ; failing one: c2f5acf48b153d6bcb786e8866744953
The only differences in installed packages show *more* in favor of successful test run. [3] vs [4]
One extra package which is installed in failing test run, but doesn't exist in passing:
> dracut-config-generic.x86_64 049-201.git20220131.el8 @baseos

[1]: https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-wallaby/482c76e/job-output.txt
[2]: https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-wallaby/8230c68/job-output.txt
[3]: https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-wallaby/482c76e/logs/undercloud/var/log/extra/package-list-installed.txt.gz
[4]: https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-wallaby/8230c68/logs/undercloud/var/log/extra/package-list-installed.txt.gz

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to tripleo-quickstart-extras (master)

Reviewed: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/831569
Committed: https://opendev.org/openstack/tripleo-quickstart-extras/commit/dcdcbd58e63691fdf9b105c74532779e426c7f09
Submitter: "Zuul (22348)"
Branch: master

commit dcdcbd58e63691fdf9b105c74532779e426c7f09
Author: Ronelle Landy <email address hidden>
Date: Wed Mar 2 13:21:44 2022 -0500

    Use the supplemental node as the DNS server

    fs039 and fs064 tests are using the standard
    DNS servers. This patch removes the standard
    servers from the /etc/resolv.conf file and
    adds the supplemental node ip.

    Change-Id: I631ec520332b5db341abe9f47e7fada940ac637e
    Related-Bug: #1962727

Dariusz Smigiel (smigiel-dariusz)
Changed in tripleo:
status: Triaged → Fix Released
status: Fix Released → Triaged
Revision history for this message
Ronelle Landy (rlandy) wrote :

revert: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/831764

Failed /ipa_prep.sh

Revision history for this message
Ronelle Landy (rlandy) wrote :

revert above not needed - patch is correct - something else is changing back the dnservers

Revision history for this message
Douglas Viroel (dviroel) wrote :

https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832670 updates previous patch and fix the issue.

testresults: https://review.rdoproject.org/r/c/testproject/+/38646/7#message-df953bbfac46e9d06f8d8d3a89cdd5ec8324484b

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832670
Committed: https://opendev.org/openstack/tripleo-quickstart-extras/commit/400dfc8285e994e7348b186794ccd5cf95778604
Submitter: "Zuul (22348)"
Branch: master

commit 400dfc8285e994e7348b186794ccd5cf95778604
Author: Douglas Viroel <email address hidden>
Date: Tue Mar 8 13:43:08 2022 -0300

    Updates baremetal-full-freeipa playbook to reload NetworkManager

    This patch updates the fix to also reload NetworkManager after making
    changes to its configuration file. It also adds 'ooo.test' as search
    domain since it is hardcoded in deploy_freeipa.sh script.

    Related-Bug: #1962727
    Change-Id: If0eebb2903649bd0a9a2f4a184c2cc3daf9dc4e5

Revision history for this message
Ronelle Landy (rlandy) wrote :

https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/832670 merged - closing out

Changed in tripleo:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.