Pool update removes PTR records

Bug #2036750 reported by Jayce Houtman
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Designate
Fix Released
Critical
Erik Olof Gunnar Andersson

Bug Description

I am having some issue with OpenStack Designate that whenever I use the 'designate-manage update pool' command my PTR records are unset but the actual records stay active in the reverse zone. I have tried finding the problem but sadly I cannot pinpoint where and why to problem occurs.

The screenshots below are from our development environment deployed using Kolla-Ansible. But the same happens within a new devstack environment. The problems occurs in the versions "stable/2023.1" and "stable/yoga" I have reproduced this using Devstack and using a Kolla-Ansible deployment in "stable/2023.1".

Screenshots:
(ptr record list) Before designate-manage update pool:
https://jhcsmedia.com/?f=qx2V6EAboABR7tx1Jjm7Dt26bi8hRKEd.png

(ptr record list) After designate-manage update pool:
https://jhcsmedia.com/?f=FL1bn7dAmU0lczsai2p3qS1zLu1ye21R.png

(record list) Records in zone after designate-manage update pool:
https://jhcsmedia.com/?f=hNUSSz1XB92BYixtI9N6KVyy53SjzmqA.png

How to reproduce in DevStack?
1. Install DevStack with OpenStack designate installed the Local.conf I used below:
 [[local|localrc]]
 ADMIN_PASSWORD=<password>
 DATABASE_PASSWORD=$ADMIN_PASSWORD
 RABBIT_PASSWORD=$ADMIN_PASSWORD
 SERVICE_PASSWORD=$ADMIN_PASSWORD
 HOST_IP=<ip-address>
 SERVICE_HOST=$HOST_IP

 # Enable designate
 enable_plugin designate https://opendev.org/openstack/designate
 enable_service designate,designate-central,designate-api,designate-worker,designate-producer,designate-mdns,designate-sink

2. After devstack has been installed create a Floating IP:
   openstack floating ip create public

3. Now set a PTR record for the Floating IP
   openstack ptr record set <Region (RegionOne)>:<Floating IP UUID> devstack.example.com.

4. Wait until the record has been set as "ACTIVE" in the reverse zone (don't know if this is required of not)
   openstack record list --all <reverse_zone_id>. (Use --all because the zone is place under the 00000000-0000-0000-0000-000000000000 project)

5. Update the designate pool using the command: designate-manage update pool With or without the pools.yaml file has the same effect.
   designate-manage pool update [--file /etc/designate/pools.yaml]

6. Wait for the designate-manage pool update to finish after which the PTR record will be shown as empty (None) using the ptr record list command even tough they are still listed in the zone when u use the record list command again
   openstack ptr record list
   openstack record list --all <reverse_zone_id>

It almost seems like the records are removed from the database and are then are put back with a new ID and without the ptr:floatingip and managed_resource_id, tenant_id and managed_tenant_id fields filled.

If any more information is required or if I can help in any way please let me know.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (master)

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/designate/+/894898

Changed in designate:
status: New → In Progress
Changed in designate:
importance: Undecided → Critical
assignee: nobody → Erik Olof Gunnar Andersson (eandersson)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/2023.2)

Fix proposed to branch: stable/2023.2
Review: https://review.opendev.org/c/openstack/designate/+/895920

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/2023.1)

Fix proposed to branch: stable/2023.1
Review: https://review.opendev.org/c/openstack/designate/+/896063

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/zed)

Fix proposed to branch: stable/zed
Review: https://review.opendev.org/c/openstack/designate/+/896101

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/yoga)

Fix proposed to branch: stable/yoga
Review: https://review.opendev.org/c/openstack/designate/+/896064

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/xena)

Fix proposed to branch: stable/xena
Review: https://review.opendev.org/c/openstack/designate/+/896065

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/wallaby)

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/designate/+/896102

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/victoria)

Fix proposed to branch: stable/victoria
Review: https://review.opendev.org/c/openstack/designate/+/896103

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to designate (stable/ussuri)

Fix proposed to branch: stable/ussuri
Review: https://review.opendev.org/c/openstack/designate/+/896104

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (master)

Reviewed: https://review.opendev.org/c/openstack/designate/+/894898
Committed: https://opendev.org/openstack/designate/commit/aaed97875c870d4807bcb6694345ea2e80f437f8
Submitter: "Zuul (22348)"
Branch: master

commit aaed97875c870d4807bcb6694345ea2e80f437f8
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886

Changed in designate:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/2023.2)

Reviewed: https://review.opendev.org/c/openstack/designate/+/895920
Committed: https://opendev.org/openstack/designate/commit/2e9de97f1b7c67bf82faf731824f76ab3bd48b5e
Submitter: "Zuul (22348)"
Branch: stable/2023.2

commit 2e9de97f1b7c67bf82faf731824f76ab3bd48b5e
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to designate (master)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896061
Committed: https://opendev.org/openstack/designate/commit/79aac2b2062f0379eaa7b105f5722bd4cbf0ad8d
Submitter: "Zuul (22348)"
Branch: master

commit 79aac2b2062f0379eaa7b105f5722bd4cbf0ad8d
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Thu Sep 21 05:04:41 2023 -0700

    Prevent XFR from being used on PRIMARY zones

    - Added constant for PRIMARY / SECONDARY.

    Related-Bug: #2036750
    Change-Id: Ie0419cdb52dbfcb813faf9070110a2635a46ed51

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to designate (stable/2023.2)

Related fix proposed to branch: stable/2023.2
Review: https://review.opendev.org/c/openstack/designate/+/896528

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/designate 17.0.0.0rc2

This issue was fixed in the openstack/designate 17.0.0.0rc2 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896102
Committed: https://opendev.org/openstack/designate/commit/a843e4ff3d7f34e8908776062b89e40e9e010118
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit a843e4ff3d7f34e8908776062b89e40e9e010118
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886
    (cherry picked from commit aaed97875c870d4807bcb6694345ea2e80f437f8)
    (cherry picked from commit f2624f73cf3b9b95b7342ca8c89ef9b8e7e438e4)

tags: added: in-stable-wallaby
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/yoga)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896064
Committed: https://opendev.org/openstack/designate/commit/c8b8124d3dd281e19866299da07cce6fc7290a65
Submitter: "Zuul (22348)"
Branch: stable/yoga

commit c8b8124d3dd281e19866299da07cce6fc7290a65
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886
    (cherry picked from commit aaed97875c870d4807bcb6694345ea2e80f437f8)

tags: added: in-stable-yoga
tags: added: in-stable-xena
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/xena)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896065
Committed: https://opendev.org/openstack/designate/commit/f9be4e2617a5a2ae475eb83275c0045b39fe597b
Submitter: "Zuul (22348)"
Branch: stable/xena

commit f9be4e2617a5a2ae475eb83275c0045b39fe597b
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886
    (cherry picked from commit aaed97875c870d4807bcb6694345ea2e80f437f8)
    (cherry picked from commit f2624f73cf3b9b95b7342ca8c89ef9b8e7e438e4)

tags: added: in-stable-victoria
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/victoria)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896103
Committed: https://opendev.org/openstack/designate/commit/de6715d961becd6962c7d8f8def6c2eda9c7351c
Submitter: "Zuul (22348)"
Branch: stable/victoria

commit de6715d961becd6962c7d8f8def6c2eda9c7351c
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886
    (cherry picked from commit aaed97875c870d4807bcb6694345ea2e80f437f8)
    (cherry picked from commit f2624f73cf3b9b95b7342ca8c89ef9b8e7e438e4)

tags: added: in-stable-zed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/zed)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896101
Committed: https://opendev.org/openstack/designate/commit/87b775ff86877dfa7084799779fe2f11da420a33
Submitter: "Zuul (22348)"
Branch: stable/zed

commit 87b775ff86877dfa7084799779fe2f11da420a33
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886
    (cherry picked from commit aaed97875c870d4807bcb6694345ea2e80f437f8)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/2023.1)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896063
Committed: https://opendev.org/openstack/designate/commit/638efa29ea9b596814a98211d792caa3083f44b4
Submitter: "Zuul (22348)"
Branch: stable/2023.1

commit 638efa29ea9b596814a98211d792caa3083f44b4
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886
    (cherry picked from commit aaed97875c870d4807bcb6694345ea2e80f437f8)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to designate (stable/ussuri)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896104
Committed: https://opendev.org/openstack/designate/commit/9a838ecbe0febceec1408f24735f3bc06d283054
Submitter: "Zuul (22348)"
Branch: stable/ussuri

commit 9a838ecbe0febceec1408f24735f3bc06d283054
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Wed Sep 20 14:49:53 2023 -0700

    Fix bug with designate-manage pool update losing existing record data

    When designate-manage pool update is used we trigger an AFXR and
    use that information to rebuild the zone. This is however only valid
    for secondary zones, as the AXFR does not contain all the internal
    information required for a primary zone and that causes designate to
    lose important internal record data.

    Closes-Bug: #2036750
    Change-Id: I77a5d05cd8f55e975a16cb386221d53b63131886
    (cherry picked from commit aaed97875c870d4807bcb6694345ea2e80f437f8)
    (cherry picked from commit f2624f73cf3b9b95b7342ca8c89ef9b8e7e438e4)

tags: added: in-stable-ussuri
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to designate (stable/2023.2)

Reviewed: https://review.opendev.org/c/openstack/designate/+/896528
Committed: https://opendev.org/openstack/designate/commit/0577a1df72083fb5c2956dca3142dc2342b3556b
Submitter: "Zuul (22348)"
Branch: stable/2023.2

commit 0577a1df72083fb5c2956dca3142dc2342b3556b
Author: Erik Olof Gunnar Andersson <email address hidden>
Date: Thu Sep 21 05:04:41 2023 -0700

    Prevent XFR from being used on PRIMARY zones

    - Added constant for PRIMARY / SECONDARY.

    Related-Bug: #2036750
    Change-Id: Ie0419cdb52dbfcb813faf9070110a2635a46ed51
    (cherry picked from commit 79aac2b2062f0379eaa7b105f5722bd4cbf0ad8d)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.