neutron

Metadata-agent sends a lot of same requests to neutron-server during cloud-init

Bug #1276440 reported by Jakub Libosvar
10
This bug affects 1 person
Affects Status Importance Assigned to Milestone
neutron
Fix Released
Medium
Jakub Libosvar
neutron 2014.2 "juno"
Icehouse
Fix Released
Undecided
Unassigned
neutron 2014.1.2

Bug Description

When cloud-init is running metadata-agent sends a lot of same requests to neutron-server. These requests serves for obtaining instance_id and tenant_id of running instance. When higher amount of instances is started at once mentioned requests cause high load for neutron-server.

Requests could be cached with small ttl.

Jakub Libosvar (libosvar)
Changed in neutron:
assignee: nobody → Jakub Libosvar (libosvar)
OpenStack Infra (hudson-openstack)
Changed in neutron:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to neutron (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/72680

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to neutron (master)

Reviewed: https://review.openstack.org/71260
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=494a0f844d4a6f4cb0e3358c3403db81a66ca96f
Submitter: Jenkins
Branch: master

commit 494a0f844d4a6f4cb0e3358c3403db81a66ca96f
Author: Jakub Libosvar <email address hidden>
Date: Wed Feb 5 10:07:02 2014 +0100

    Copy cache package from oslo-incubator

    Related-Bug: #1276440
    Change-Id: I7aaf8ae2eb909816d85092baa5c111f00e60d2c7

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to neutron (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/75804

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to neutron (master)

Reviewed: https://review.openstack.org/75804
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=cd6e9ad2c1d107424a1635afcb841f016e97fe67
Submitter: Jenkins
Branch: master

commit cd6e9ad2c1d107424a1635afcb841f016e97fe67
Author: Jakub Libosvar <email address hidden>
Date: Mon Feb 24 09:37:11 2014 +0100

    Sync oslo cache with oslo-incubator

    Due to removal of py3kcompat we need to sync with
    oslo-incubator in order to use six package directly.

    Related-Bug: #1276440
    Change-Id: Ib3d1c9e09497f7ecd7495ef0f70c6105c14a9783

Mark McClain (markmcclain)
tags: added: icehouse-rc-potential l3-ipam-dhcp
Mark McClain (markmcclain)
tags: added: icehouse-backport-potential
removed: icehouse-rc-potential
Changed in neutron:
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/72680
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=7508170498949818aed02ba0fd9b7f861e596320
Submitter: Jenkins
Branch: master

commit 7508170498949818aed02ba0fd9b7f861e596320
Author: Jakub Libosvar <email address hidden>
Date: Tue Feb 11 15:59:06 2014 +0100

    Common decorator for caching methods

    Decorator caches methods' results, the key is composed from function
    name and its parameters. Implementation of cache itself should be in
    object implementing decorated method. Cache backend should be taken
    from oslo-incubator.

    Related-Bug: #1276440
    Change-Id: Ibe3f1b2eb10b9601ad76ec24b7f0e3551b4013e2

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (master)

Reviewed: https://review.openstack.org/70689
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=3faea81c6029033c85cefd6e98d7a3e719e858f5
Submitter: Jenkins
Branch: master

commit 3faea81c6029033c85cefd6e98d7a3e719e858f5
Author: Jakub Libosvar <email address hidden>
Date: Thu Jan 30 15:27:02 2014 +0100

    Metadata agent caches networks for routers

    During cloud-init there are several calls that asks neutron API for the
    same data which will not be most likely changed. Specifically router's
    networks are cached.

    Closes-bug: #1276440
    Change-Id: Ic5eedb8057c7f4934eed08869ebf55c91e6edfc9

Changed in neutron:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to neutron (stable/icehouse)

Related fix proposed to branch: stable/icehouse
Review: https://review.openstack.org/95490

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to neutron (stable/icehouse)

Fix proposed to branch: stable/icehouse
Review: https://review.openstack.org/95491

Thierry Carrez (ttx)
Changed in neutron:
milestone: none → juno-1
status: Fix Committed → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to neutron (stable/icehouse)

Reviewed: https://review.openstack.org/95490
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=9ce5ef3536152a24af949899cd1787dacc994f37
Submitter: Jenkins
Branch: stable/icehouse

commit 9ce5ef3536152a24af949899cd1787dacc994f37
Author: Jakub Libosvar <email address hidden>
Date: Tue Feb 11 15:59:06 2014 +0100

    Common decorator for caching methods

    Decorator caches methods' results, the key is composed from function
    name and its parameters. Implementation of cache itself should be in
    object implementing decorated method. Cache backend should be taken
    from oslo-incubator.

    Related-Bug: #1276440

    Conflicts:
     neutron/common/utils.py

    Change-Id: Ibe3f1b2eb10b9601ad76ec24b7f0e3551b4013e2
    (cherry picked from commit 7508170498949818aed02ba0fd9b7f861e596320)

tags: added: in-stable-icehouse
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to neutron (stable/icehouse)

Reviewed: https://review.openstack.org/95491
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=ce712b2ab56f2aeaf9fe01929c0034ef8f4a766a
Submitter: Jenkins
Branch: stable/icehouse

commit ce712b2ab56f2aeaf9fe01929c0034ef8f4a766a
Author: Jakub Libosvar <email address hidden>
Date: Thu Jan 30 15:27:02 2014 +0100

    Metadata agent caches networks for routers

    During cloud-init there are several calls that asks neutron API for the
    same data which will not be most likely changed. Specifically router's
    networks are cached.

    Closes-bug: #1276440

    Conflicts:
     neutron/tests/unit/test_metadata_agent.py

    Change-Id: Ic5eedb8057c7f4934eed08869ebf55c91e6edfc9
    (cherry picked from commit 3faea81c6029033c85cefd6e98d7a3e719e858f5)

Chuck Short (zulcss)
tags: removed: icehouse-backport-potential
Revision history for this message
Scott Moser (smoser) wrote :

Oddly, it seems like this change caused a performance regression rather than improvement.
I'm not sure exactly why that is, but under bug 1361357 we've bisected it to be the root cause.

Thierry Carrez (ttx)
Changed in neutron:
milestone: juno-1 → 2014.2
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.