Verification was performed with the Stein Cloud Archive on Bionic:

======
Totals
======
Ran: 97 tests in 685.4942 sec.
 - Passed: 89
 - Skipped: 8
 - Expected Fail: 0
 - Unexpected Success: 0
 - Failed: 0
Sum of execute time for each test: 1074.9082 sec.

Summary of tests run:

{1} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor [0.187747s] ... ok
{1} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors [0.067206s] ... ok
{3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create [1.311727s] ... ok
{3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list [8.541252s] ... ok
{1} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete [16.926876s] ... ok
{0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers [1.308775s] ... ok
{0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details [0.000830s] ... ok
{3} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers [0.225572s] ... ok
{3} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details [0.001396s] ... ok
{1} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers [0.186995s] ... ok
{1} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details [0.000916s] ... ok
{2} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesUnderV243Test.test_add_remove_fixed_ip [152.968351s] ... ok
{3} setUpClass (tempest.api.identity.admin.v2.test_users.UsersTestJSON) ... SKIPPED: Identity api v2 is not enabled
{3} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list [2.154145s] ... ok
{2} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete [1.656506s] ... ok
{1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete [8.051045s] ... ok
{3} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service [1.737159s] ... ok
{3} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image [0.600384s] ... ok
{2} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain [1.309934s] ... ok
{3} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file [0.964685s] ... ok
{3} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image [0.134652s] ... ok
{1} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy [1.713314s] ... ok
{2} setUpClass (tempest.api.identity.v2.test_api_discovery.TestApiDiscovery) ... SKIPPED: Identity api v2 is not enabled
{0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard [28.673241s] ... ok
{3} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions [0.008911s] ... ok
{2} tempest.api.identity.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists [0.165934s] ... ok
{3} setUpClass (tempest.api.network.test_ports.PortsIpV6TestJSON) ... SKIPPED: IPv6 Tests are disabled.
{1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id [0.428502s] ... ok
{1} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions [3.335406s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [26.069716s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility [1.043949s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.627121s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.247971s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_show_network [0.680043s] ... ok
{2} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.231862s] ... ok
{0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses [0.078294s] ... ok
{0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network [0.158632s] ... ok
{2} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [18.705019s] ... ok
{0} tempest.api.compute.test_versions.TestVersions.test_get_version_details [0.620578s] ... ok
{0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions [0.007700s] ... ok
{0} setUpClass (tempest.api.identity.admin.v2.test_services.ServicesTestJSON) ... SKIPPED: Identity api v2 is not enabled
{0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint [0.533920s] ... ok
{1} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address [29.442012s] ... ok
{3} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces [87.668599s] ... ok
{0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all [4.087738s] ... ok
{2} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups [22.335460s] ... ok
{2} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [5.397217s] ... ok
{2} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.147981s] ... ok
{2} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.148444s] ... ok
{0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types [0.033951s] ... ok
{0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources [0.025050s] ... ok
{0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses [0.037476s] ... ok
{0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions [0.006862s] ... ok
{2} setUpClass (tempest.api.network.test_security_groups.SecGroupIPv6Test) ... SKIPPED: IPv6 Tests are disabled.
{1} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip [30.808074s] ... ok
{2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [2.778641s] ... ok
{0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network [11.583411s] ... ok
{2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object [2.590985s] ... ok
{3} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id [45.463605s] ... ok
{2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects [2.686323s] ... ok
{2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object [2.527480s] ... ok
{0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port [8.779459s] ... ok
{1} setUpClass (tempest.api.network.test_networks.BulkNetworkOpsIpV6Test) ... SKIPPED: IPv6 Tests are disabled.
{1} setUpClass (tempest.api.network.test_networks.NetworksIpV6Test) ... SKIPPED: IPv6 Tests are disabled.
{2} tempest.api.volume.test_versions.VersionsTest.test_list_versions [0.024011s] ... ok
{1} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources [0.022025s] ... ok
{1} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details [0.114976s] ... ok
{1} tempest.api.object_storage.test_object_services.ObjectTest.test_create_object [0.153229s] ... ok                                     
{1} tempest.api.object_storage.test_object_services.ObjectTest.test_get_object [0.074597s] ... ok
{1} tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata [0.106312s] ... ok
{1} tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata [0.132247s] ... ok
{2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list [0.077307s] ... ok
{0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet [17.628495s] ... ok
{3} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id [30.828866s] ... ok
{0} setUpClass (tempest.api.network.test_routers.RoutersIpV6Test) ... SKIPPED: IPv6 Tests are disabled.
{3} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router [10.822707s] ... ok
{0} tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata [0.123461s] ... ok
{0} tempest.api.object_storage.test_account_services.AccountTest.test_list_containers [0.032606s] ... ok
{3} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [5.697636s] ... ok
{3} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [2.978959s] ... ok
{3} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.122528s] ... ok
{3} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota [0.612646s] ... ok
{3} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object [0.148178s] ... ok
{0} tempest.api.object_storage.test_container_services.ContainerTest.test_create_container [2.376884s] ... ok
{0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents [2.414568s] ... ok
{0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata [2.352609s] ... ok
{1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance [34.492738s] ... ok
{1} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete [6.802898s] ... ok
{1} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image [11.565944s] ... ok
{3} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops [74.019001s] ... ok
{2} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes [120.164149s] ... ok
{3} designate_tempest_plugin.tests.api.v2.test_recordset.RecordsetsTest.test_create_recordset [0.284612s] ... ok
{3} designate_tempest_plugin.tests.api.v2.test_zones.ZonesTest.test_delete_zone [6.902233s] ... ok
{0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops [177.506004s] ... ok
{2} designate_tempest_plugin.tests.scenario.v2.test_zones.ZonesTest.test_create_and_delete_zone [13.121721s] ... ok
{0} designate_tempest_plugin.tests.api.v2.test_zones_exports.ZonesExportTest.test_show_zone_export [7.208466s] ... ok
{0} designate_tempest_plugin.tests.api.v2.test_zones_imports.ZonesImportTest.test_show_zone_import [7.780568s] ... ok