Bazaar Git Plugin

git: bzrlib [ERNO 24] too many open files

Bug #932555 reported by jugglefish
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Bazaar Git Plugin
Triaged
Medium
Unassigned
Breezy
Fix Released
Medium
Jelmer Vernooij
Breezy 3.0.0 "Pelican"

Bug Description

still trying to fetch a 40k revisions branch with a lot of criss-cross merging from a pretty huge bzr repo (lp:openobject-addons)

I now stepped down to do it in single steps per mainline commit (by pulling into a local bzr branch with bzr pull -r
XY). After ~6 days of processing I am at revno 6081 but now I am running into a problem:

git fetch bzr::/tmp/bzr-addons-trunk :refs/remotes/bzr/trunk
Traceback (most recent call last):
  File "/usr/lib/git-core/git-remote-bzr", line 49, in <module>
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/git_remote_helper.py", line 168, in process
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/git_remote_helper.py", line 174, in process_line
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/git_remote_helper.py", line 79, in fetch
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 260, in fetch_refs
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 278, in fetch_objects
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 202, in missing_revisions
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/push.py", line 171, in _commit_needs_fetching
  File "/usr/lib/python2.7/dist-packages/dulwich/object_store.py", line 95, in __contains__
  File "/usr/lib/python2.7/dist-packages/dulwich/object_store.py", line 291, in contains_loose
  File "/usr/lib/python2.7/dist-packages/bzrlib/plugins/git/transportgit.py", line 490, in _get_loose_object
  File "/usr/lib/python2.7/dist-packages/bzrlib/transport/local.py", line 170, in get
  File "/usr/lib/python2.7/dist-packages/bzrlib/transport/__init__.py", line 358, in _translate_error
bzrlib.errors.TransportError: Transport error: [Errno 24] Too many open files: u'/opt/openerp-git/addons/.git/objects/98/24178f223c07deb6a1fe757fb632c1ea82c660' [Errno 24] Too many open files: u'/opt/openerp-git/addons/.git/objects/98/24178f223c07deb6a1fe757fb632c1ea82c660'
fehler

Anything I can do to recover from here?

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

Can you try this with trunk dulwich and trunk bzr-git?

Changed in bzr-git:
status: New → Triaged
importance: Undecided → Low
importance: Low → Medium
Revision history for this message
Jelmer Vernooij (jelmer) wrote :

The bzr->git support in bzr-git is still very experimental; at the moment I think we're writing one pack file per revision.

Revision history for this message
Jelmer Vernooij (jelmer) wrote :

repacking the git repo might help

Revision history for this message
jugglefish (pniederlag) wrote :

pn@h01:/opt/openerp-git/addons$ git repack
Nothing new to pack.
pn@h01:/opt/openerp-git/addons$ git repack -A -d
error: Could not read b8b1903c2f81483f14f475267f3a06778ecc211e
fatal: bad tree object b8b1903c2f81483f14f475267f3a06778ecc211e

git fsck and git gc seem to fail as well...
.. I guess I am stuck again. :-<

Getting trunk up and running has been on my list already, don't know If I can make that. sources are already in /u/l/s but still have to figure out a way to hook them into the regular package based bzr installation.

Jelmer Vernooij (jelmer)
Changed in brz-git:
status: New → Triaged
importance: Undecided → Medium
Jelmer Vernooij (jelmer)
Changed in brz-git:
status: Triaged → Fix Released
milestone: none → integration
assignee: nobody → Jelmer Vernooij (jelmer)
Jelmer Vernooij (jelmer)
affects: brz-git → brz
Changed in brz:
milestone: integration → none
summary: - bzrlib [ERNO 24] too many open files
+ git: bzrlib [ERNO 24] too many open files
Changed in brz:
milestone: none → 3.0.0
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.