Dashboard take 5-10 secs for OpenStack operations

Bug #1624264 reported by Junaid Ali
56
This bug affects 11 people
Affects Status Importance Assigned to Milestone
OpenStack Dashboard (Horizon)
Incomplete
Undecided
Unassigned
horizon (Ubuntu)
Triaged
High
Unassigned

Bug Description

Dashboard takes around 5-10secs for OpenStack operations (e.g opening instance's page etc) from project panel in admin tenant. Although, if we open any page from admin panel, it takes around 2-3 seconds. Similarly, if we open any page from any other tenant, 5-10 secs are consumed.
CLI commands seem to be working fine as they take around 1-3.5 secs.

Please let me know the logs to share. Neutron, Keystone, Nova logs doesn't show any errors regarding slowness in API calls.

OpenStack Release: Mitaka
Horizon version: 9.1.0

Revision history for this message
Junaid Ali (junaidali) wrote :

Charm configurations that I'm using are:

mysql:
    dataset-size: 4G
    max-connections: 20000
    root-password: "admin"
    sst-password: "admin"
    vip: "<MYSQL_VIP>"
    vip_cidr: <NETWORK_PREFIX>
    vip_iface: "eth0"
hacluster-mysql:
    corosync_transport: unicast
    cluster_count: 3
    monitor_host: "<MONITOR_HOST_IP>"
keystone:
    admin-password: "admin"
    admin-token: "admin"
    region: "serverstack"
    openstack-origin: "cloud:trusty-mitaka"
    vip: "<KEYSTONE_VIP>"
    worker-multiplier: "1"
hacluster-keystone:
    cluster_count: 3
    corosync_transport: unicast
    monitor_host: "<MONITOR_HOST_IP>"
openstack-dashboard:
    vip: "<DASHBOARD_VIP>"
    openstack-origin: "cloud:trusty-mitaka"
hacluster-dashboard:
    cluster_count: 3
    corosync_transport: unicast
    monitor_host: "<MONITOR_HOST_IP>"
nova-compute:
    enable-live-migration: "True"
    enable-resize: "True"
    openstack-origin: "cloud:trusty-mitaka"
    migration-auth-type: "ssh"
    manage-neutron-plugin-legacy-mode: False
nova-cloud-controller:
    network-manager: "Neutron"
    console-access-protocol: "novnc"
    openstack-origin: "cloud:trusty-mitaka"
    region: "serverstack"
    single-nova-consoleauth: "False"
    vip: "<NOVA_CLOUD_CONTROLLER_VIP>"
    worker-multiplier: "1"
hacluster-nova-cc:
    cluster_count: 3
    monitor_host: "<MONITOR_HOST_IP>"
    corosync_transport: unicast
neutron-api:
    openstack-origin: "cloud:trusty-mitaka"
    neutron-security-groups: "True"
    neutron-plugin: "plumgrid"
    manage-neutron-plugin-legacy-mode: False
    region: "serverstack"
    vip: "<NEUTRON_VIP>"
    worker-multiplier: "1"
hacluster-neutron-api:
    cluster_count: 3
    monitor_host: "<MONITOR_HOST_IP>"
    corosync_transport: unicast
glance:
    openstack-origin: "cloud:trusty-mitaka"
    region: "serverstack"
    vip: "<GLANCE_VIP>"
    worker-multiplier: "1"
hacluster-glance:
    cluster_count: 3
    monitor_host: "<MONITOR_HOST_IP"
    corosync_transport: unicast
rabbitmq-server:
    vip: "<RABBIT_MQ_VIP>"

Liam Young (gnuoy)
Changed in horizon:
status: New → Confirmed
status: Confirmed → New
Revision history for this message
Launchpad Janitor (janitor) wrote :

Status changed to 'Confirmed' because the bug affects multiple users.

Changed in horizon (Ubuntu):
status: New → Confirmed
Revision history for this message
Richard Jones (r1chardj0n3s) wrote :

The Horizon team is aware that those panels incur a significant delay when loading or performing some actions. We are actively migrating the interface over to a more client-side approach which reduces the per-action (page load or otherwise) overhead significantly. If you wish to see this in action, please look at the reimplemented Containers or Images panels.

The effort to complete those reimplementations is ongoing.

Changed in horizon:
status: New → Triaged
importance: Undecided → High
Revision history for this message
Junaid Ali (junaidali) wrote :

Sharing the logs that Narinder Gupta suggested to update with.

Revision history for this message
Junaid Ali (junaidali) wrote :

Output of ps -ef on controller node 1

Revision history for this message
Junaid Ali (junaidali) wrote :

Output of ps -ef on controller node 2

Revision history for this message
Junaid Ali (junaidali) wrote :

Output of ps -ef on controller node 3

Revision history for this message
Junaid Ali (junaidali) wrote :

screenshot of command 'top' on controller 1

Revision history for this message
Junaid Ali (junaidali) wrote :

screenshot of command 'top' on controller 2 and 3

Revision history for this message
Junaid Ali (junaidali) wrote :
Revision history for this message
Junaid Ali (junaidali) wrote :
Revision history for this message
Junaid Ali (junaidali) wrote :

output of ps -ef in each dashboard lxc

Revision history for this message
Junaid Ali (junaidali) wrote :

output of
$ juju get openstack-dashboard

Changed in horizon (Ubuntu):
status: Confirmed → Triaged
importance: Undecided → High
Revision history for this message
Akihiro Motoki (amotoki) wrote :

I tested with my local env which has 10 instances in a single project with Queens development version. They are based on Chrome development tools.
The first component is the time required to load the main page. The second component is the time required to load the related things like (JS, header, image).

Project Overview : 1.02 sec + 1.46sec (= 2.48 sec)
Project Instances : 2.77sec + 1.58 sec (= 4.35 sec)
Admin Overview : 1.40 sec + 1.46 sec (= 2.86 sec)
Admin Instances : 2.08 sec + 1.29 sec (= 3.37 sec)

The result is not so bad compared to the reported result.

It seems horizon needs additional ~1.5 sec to load extra contents (like JS and so on).
The time required to process a main page depends on contents, but 10 sec looks longer.

Revision history for this message
Akihiro Motoki (amotoki) wrote :

Considering my test result, 10 sec sounds a bit longer so we would like to know more detail test conditions. My test environment is not so special as my machine is a couple of years old.
I think we need more condition to evaluate this bug. Let me mark this as Incomplete.

Changed in horizon:
status: Triaged → Incomplete
Revision history for this message
Akihiro Motoki (amotoki) wrote :

Due to the nature of Incomplete status, let's change the priority to Undecided (in horizon).

Changed in horizon:
importance: High → Undecided
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.