annotation is slow in 2a and pack repositories

Bug #153787 reported by Robert Collins
20
Affects Status Importance Assigned to Milestone
Bazaar
Confirmed
High
canonical-bazaar
Breezy
Triaged
Medium
Unassigned

Bug Description

2a repositories don't store history as line deltas and don't store the origin revision of each line. Therefore annotation must be done by extracting all the texts from the file's history and diffing them.

Extraction from 2a is thought to be fairly fast so the next useful step is to either:

 * generate annotations incrementally into a gui
 * have a cache of annotation results

Changed in bzr:
importance: Undecided → Medium
status: New → Triaged
Martin Pool (mbp)
Changed in bzr:
importance: Medium → High
status: Triaged → Confirmed
Revision history for this message
Martin Pool (mbp) wrote :

john is working on this

Changed in bzr:
assignee: nobody → jameinel
Johan Walles (walles)
tags: added: performance
Revision history for this message
John A Meinel (jameinel) wrote :

Note that 2a format repos makes this even worse, because now we have to do deltas for *all* texts, (we can't extract a pre-canned diff for the left-hand parent like we could in knitpack.)

Revision history for this message
John A Meinel (jameinel) wrote :

Unassigning myself, since for now I'm not focusing on it. I did make annotate faster, but not wrt having an annotation cache.

Changed in bzr:
assignee: John A Meinel (jameinel) → nobody
Martin Pool (mbp)
tags: added: 2a
description: updated
summary: - annotation is slow in pack repositories
+ annotation is slow in 2a and pack repositories
Revision history for this message
GuilhemBichot (guilhem-bichot) wrote :

For my planning I wonder: will a fix for this slow annotate require a new repository format (newer than 2a)? Thanks.

Revision history for this message
Martin Pool (mbp) wrote : Re: [Bug 153787] Re: annotation is slow in 2a and pack repositories

On 31 March 2010 19:56, GuilhemBichot <email address hidden> wrote:
> For my planning I wonder: will a fix for this slow annotate require a
> new repository format (newer than 2a)? Thanks.

No, we're planning to just make it faster inside this format by some or all of:

 * simply generate them faster
 * hold a cache of annotation information
 * yield annotation results with progressively increasing amounts of detail

--
Martin <http://launchpad.net/~mbp/>

Revision history for this message
GuilhemBichot (guilhem-bichot) wrote :

we just converted our central repository and all devs to bzr format 2a. The annotate slowdown is well observed (from 16 secs in format 1.9 to 32 secs in format 2a). I hope this could be worked on.

Martin Pool (mbp)
Changed in bzr:
assignee: nobody → canonical-bazaar (canonical-bazaar)
Jelmer Vernooij (jelmer)
tags: added: check-for-breezy
Jelmer Vernooij (jelmer)
tags: removed: check-for-breezy
Changed in brz:
status: New → Triaged
importance: Undecided → Medium
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.