In Openstack with DNS guideline (https://refstack.openstack.org/v1/guidelines/dns.2020.11.json/tests?target=dns&type=required&alias=true&flag=false)
two test cases have incorrect names:
1. designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types
2. designate_tempest_plugin.tests.api.v2.test_zones.ZonesTest.test_list_zone
In test case, designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types
when I executed tempest run -l | grep .test_create_all_recordset_types
to view test cases it gives
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00008_SSHFP[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00004_SRV_UDP[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00007_MX_under_APEX[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00005_CNAME[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00002_AAAA[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00001_A[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00006_MX_at_APEX[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00009_TXT[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_all_recordset_types_00003_SRV_TCP[id-d03b69a5-5052-43bc-a38a-b511b6b34304]
and these test cases are not present in guidelines.
and in test case designate_tempest_plugin.tests.api.v2.test_zones.ZonesTest.test_list_zone
test case name muse be designate_tempest_plugin.tests.api.v2.test_zones.ZonesTest.test_list_zones
(i.e. test_list_zone => test_list_zones)
https://github.com/openstack/designate-tempest-plugin/blob/ffc1be4ef4ab62a9d51e635e96c1a0a609d2f75e/designate_tempest_plugin/tests/api/v2/test_zones.py#L120
Actual:
Incorrect test case names are added in Openstack with DNS guideline
Expected in bug:
Guideline muse be updated with correct test cases names.
This is a bug on designate's side - https:/ /bugs.launchpad .net/designate/ +bug/1943115
Meanwhile, the related designate tests were flagged so that they don't make any guideline fail.