openoffice.org import causing swap-death (excessive memory use)

Bug #702255 reported by Tom Haddon
22
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Bazaar
Invalid
Undecided
Unassigned
Bazaar Hg Plugin
Triaged
High
Unassigned
Launchpad itself
Won't Fix
High
Unassigned

Bug Description

We got swap alerts on pear and eventually had to kill the process. Memory usage was visibly increasing within the space of a few minutes:

importd@pear:~$ ps fuwwxx | grep 27499
importd 14784 0.0 0.0 7624 808 pts/0 D+ 08:08 0:00 \_ grep 27499
importd 27499 69.4 59.9 6457848 3663916 pts/6 Rs+ 07:15 36:23 \_ /usr/bin/python /srv/importd.launchpad.net/production/launchpad-rev-12177/scripts/code-import-worker.py 416569 hg http://hg.services.openoffice.org/DEV300
importd@pear:~$ ps fuwwxx | grep 27499
importd 27499 69.7 60.6 6967096 3707156 pts/6 Rs+ 07:15 40:37 \_ /usr/bin/python /srv/importd.launchpad.net/production/launchpad-rev-12177/scripts/code-import-worker.py 416569 hg http://hg.services.openoffice.org/DEV300
importd@pear:~$ ps fuwwxx | grep 27499
importd 19886 0.0 0.0 6208 636 pts/0 D+ 08:15 0:00 \_ grep 27499
importd 27499 70.2 62.9 7130472 3848096 pts/6 Rs+ 07:15 41:58 \_ /usr/bin/python /srv/importd.launchpad.net/production/launchpad-rev-12177/scripts/code-import-worker.py 416569 hg http://hg.services.openoffice.org/DEV300

Tom Haddon (mthaddon)
tags: added: canonical-losa-lp
Revision history for this message
Robert Collins (lifeless) wrote :

Do we have ulimits on those processes?

tags: added: code-import
Changed in launchpad:
status: New → Triaged
importance: Undecided → High
summary: - openoffice.org import using excessive memory
+ openoffice.org import causing swap-death (excessive memory use)
Revision history for this message
Martin Pool (mbp) wrote :

Also, are we getting meliae dumps from failures? I guess not.

Revision history for this message
Robert Collins (lifeless) wrote : Re: [Bug 702255] Re: openoffice.org import causing swap-death (excessive memory use)

I don't think we've got meliae hooked up to that service. Its a good idea.

Revision history for this message
Martin Pool (mbp) wrote :

bug 702520 for meliae

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

Unfortunately this is an issue with the current bzr-hg architecture, which isn't really appropriate for openoffice.org-sized trees. I have some ideas about how to improve that but have not yet had time to implement them.

Changed in bzr:
status: New → Invalid
Changed in bzr-hg:
status: New → Triaged
importance: Undecided → High
Revision history for this message
Данило Шеган (danilo) wrote :

As reported in https://answers.launchpad.net/launchpad/+question/160305, it seems Python import is failing with a out-of-memory error as well (or recently, with KILL/TERM signals, probably due to our safe-guards in place).

https://code.launchpad.net/~python-dev/python/default

tags: added: memory
Jelmer Vernooij (jelmer)
tags: added: bzr-hg
Curtis Hovey (sinzui)
Changed in launchpad:
status: Triaged → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Related questions

Remote bug watches

Bug watches keep track of this bug in other bug trackers.