Mirantis OpenStack

pymongo 2.6 causes memory leak

  1. Series 5.1.x
  2. Bug #1425603
Bug #1425603 reported by Evgeniy Afonichev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Released
High
Ivan Berezovskiy
Mirantis OpenStack 6.1
5.1.x
Fix Committed
High
Ivan Berezovskiy
Mirantis OpenStack 5.1.1-updates
6.0.x
Fix Released
High
Denis Meltsaykin
Mirantis OpenStack 6.0-mu-2

Bug Description

The original issue https://bugs.launchpad.net/oslo.messaging/+bug/1372835
The fix proposed https://review.openstack.org/#/c/123995/ (not yet merged)
Please note it's in openstack/requirements component

In my case this issue affects ceilometer

"During execution of long term stability test it was found that the memory usage for the ceilometer-collector has been increasing steadily. For the RSS and the VSZ memory respectively the following increase values have been found. RSS increased by nearly 300% and VSZ by near to 200%"

We tested that fix and it solves the problem with memory leakage

Version: 5.1.2

Tags: ceilometer
Revision history for this message
Dmitry Mescheryakov (dmitrymex) wrote :

We need to have pymongo >= 2.6.1 to be not affected by the bug. Right now we have
 * 2.5.2 for CentOS
 * not sure what for Ubuntu Trusty

Lets update CentOS's package, and probably we will get proper update from Trusty automatically

Changed in mos:
importance: Undecided → Medium
milestone: none → 6.1
assignee: nobody → MOS Deployment Team (mos-deployment)
status: New → Confirmed
Ivan Berezovskiy (iberezovskiy)
Changed in mos:
assignee: MOS Deployment Team (mos-deployment) → Ivan Berezovskiy (iberezovskiy)
Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

We have pymongo 2.6.1 for Ubuntu 12.04 (Fuel 5.1.2) and pymongo 2.6.3 for Ubuntu 12.04 (Fuel 6.0.1 and 6.1). Need to update pymongo for CentOS only because RPM version is 2.5.2 for 5.1.2, 6.0.1 and 6.1 releases.

Revision history for this message
OSCI Robot (oscirobot) wrote :

package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4248
project: packages/centos6/pymongo
branch: 6.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:

NOTE: Changeset is not merged, created temporary package repository.
 repository URL: /centos-fuel-6.1-stable-4248/

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4249
project: packages/centos6/pymongo
branch: 6.0.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable-4249/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4250
project: packages/centos6/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable-4250/centos

Ivan Berezovskiy (iberezovskiy)
Changed in mos:
importance: Medium → High
Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

Fixes are merged for 5.1.2, 6.0.1 and 6.1

Changed in mos:
status: Confirmed → Fix Committed
Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4249
project: packages/centos6/pymongo
branch: 6.0.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0.1-stable/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4248
project: packages/centos6/pymongo
branch: 6.1
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:

Changeset merged. Package placed on primary repository
 repository URL: /centos-fuel-6.1-stable/

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4250
project: packages/centos6/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-5.1.2-stable/centos

Revision history for this message
Aleksey Zvyagintsev (azvyagintsev) wrote :

Hm, what about update this package in ubuntu-fuel-5.1.2-stable ?
Becouse currently in 5.1.2 they still python-pymongo_2.6-1~cloud1_amd64.deb

(https://osci-obs.vm.mirantis.net/package/show?package=pymongo&project=ubuntu-fuel-5.1.2-stable agregated from https://osci-obs.vm.mirantis.net/package/show?package=pymongo&project=ubuntu-cloud:havana ).
I think fix uncompleted.

Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

We need to have pymongo >= 2.6.1 to be not affected by the bug, so version for ubuntu is suitable.

Revision history for this message
Ivan Berezovskiy (iberezovskiy) wrote :

It was decided to update pymongo for Ubuntu in Fuel 5.1.2 (to use the same version as for CentOS). Change is here https://review.fuel-infra.org/#/c/4317/

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package pymongo has been built for project packages/precise/pymongo
Package version == , package release ==

Changeset: https://review.fuel-infra.org/4317
project: packages/precise/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update pymongo to 2.6.3 for Fuel 5.1.2
status: patchset-created

Files placed on repository:
python-bson-ext_2.6.3-1build1_amd64.deb
python-bson_2.6.3-1build1_amd64.deb
python-gridfs_2.6.3-1build1_all.deb
python-pymongo-doc_2.6.3-1build1_all.deb
python-pymongo-ext_2.6.3-1build1_amd64.deb
python-pymongo_2.6.3-1build1_amd64.deb
python3-bson-ext_2.6.3-1build1_amd64.deb
python3-bson_2.6.3-1build1_amd64.deb
python3-gridfs_2.6.3-1build1_all.deb
python3-pymongo-ext_2.6.3-1build1_amd64.deb
python3-pymongo_2.6.3-1build1_amd64.deb

NOTE: Changeset is not merged, created temporary package repository.
DEB repository URL: /ubuntu-fuel-5.1.2-stable-4317/ubuntu

Revision history for this message
OSCI Robot (oscirobot) wrote :

DEB package pymongo has been built for project packages/precise/pymongo
Package version == , package release ==

Changeset: https://review.fuel-infra.org/4317
project: packages/precise/pymongo
branch: 5.1.2
author: Ivan Berezovskiy
committer: Ivan Berezovskiy
subject: Update pymongo to 2.6.3 for Fuel 5.1.2
status: change-merged

Files placed on repository:
python-bson-ext_2.6.3-1build1_amd64.deb
python-bson_2.6.3-1build1_amd64.deb
python-gridfs_2.6.3-1build1_all.deb
python-pymongo-doc_2.6.3-1build1_all.deb
python-pymongo-ext_2.6.3-1build1_amd64.deb
python-pymongo_2.6.3-1build1_amd64.deb
python3-bson-ext_2.6.3-1build1_amd64.deb
python3-bson_2.6.3-1build1_amd64.deb
python3-gridfs_2.6.3-1build1_all.deb
python3-pymongo-ext_2.6.3-1build1_amd64.deb
python3-pymongo_2.6.3-1build1_amd64.deb

Changeset merged. Package placed on primary repository
DEB repository URL: /ubuntu-fuel-5.1.2-stable/ubuntu

Revision history for this message
Vadim Rovachev (vrovachev) wrote :

verified on:
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  api: "1.0"
  build_number: "178"
  build_id: "2015-03-09_22-54-44"
  nailgun_sha: "a9a6578a649a2a006c4810b3d0aa6876ac6e8b83"
  python-fuelclient_sha: "4eb787f1ad969bd23c93d192865543dbd45a8626"
  astute_sha: "2d61ee42ec6dae3181d292c7769d32e40d463893"
  fuellib_sha: "62e68af896887ebe18944e6a0a9721e269119ad4"
  ostf_sha: "8df5f2fcdae3bc9ea7d700ffd64db820baf51914"
  fuelmain_sha: "c73b87f7cbc371307a21c368a45a65aa3f4b7a5d"

Vadim Rovachev (vrovachev)
Changed in mos:
status: Fix Committed → Fix Released
Revision history for this message
Evgeniy Afonichev (eafonichev) wrote :

JFYI, today the original fix was merged finally https://review.openstack.org/#/c/123995/

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4969
project: packages/centos6/pymongo
branch: 6.0-updates
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: Update python-pymongo to 2.6.3 for CentOS
status: patchset-created

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

NOTE: Changeset is not merged, created temporary package repository.
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-updates-stable-4969/centos

Revision history for this message
OSCI Robot (oscirobot) wrote :

RPM package pymongo has been built for project packages/centos6/pymongo
Package version == 2.6.3, package release == 1

Changeset: https://review.fuel-infra.org/4969
project: packages/centos6/pymongo
branch: 6.0-updates
author: Denis Meltsaykin
committer: Denis Meltsaykin
subject: Update python-pymongo to 2.6.3 for CentOS
status: change-merged

Files placed on repository:
python-bson-2.6.3-1.mira1.x86_64.rpm
python-pymongo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-debuginfo-2.6.3-1.mira1.x86_64.rpm
python-pymongo-gridfs-2.6.3-1.mira1.x86_64.rpm

Changeset merged. Package placed on primary repository
RPM repository URL: http://osci-obs.vm.mirantis.net:82/centos-fuel-6.0-updates-stable/centos

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.