John A Meinel wrote:
> Robert Collins wrote:
>> On Tue, 2009-12-15 at 20:24 +0000, Ulrich Müller wrote:
>>>> Can you try the associated branch? It just changes the calling code
>>>> to request all file content in one pass, rather than one file at a
>>>> time.
>>> This brings the time down from 54 min to 9 min.
>>>
>>> But it still accesses the repote repo during export (in fact, from the
>>> transferred volume I would conclude that everything is re-fetched over
>>> the network).
>> Yes, that is the case. bzr doesn't have a 'local cache' when you have a
>> lightweight checkout. We could look at some complex logic to use files
>> you have locally when they are not modified, and/or to get streaming in
>> place for this operation, but it will always be slower than when you
>> have local history.
>
>> -Rob
>
>
> Note that the change I made (and proposed) does handle streaming. Hence
> the 54 min => 9 min.
The repository iter_files_bytes api does not stream yet - it uses VFS
operations.
There will be some fat still to shave there if it does start streaming ;).
- -Rob
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
John A Meinel wrote:
> Robert Collins wrote:
>> On Tue, 2009-12-15 at 20:24 +0000, Ulrich Müller wrote:
>>>> Can you try the associated branch? It just changes the calling code
>>>> to request all file content in one pass, rather than one file at a
>>>> time.
>>> This brings the time down from 54 min to 9 min.
>>>
>>> But it still accesses the repote repo during export (in fact, from the
>>> transferred volume I would conclude that everything is re-fetched over
>>> the network).
>> Yes, that is the case. bzr doesn't have a 'local cache' when you have a
>> lightweight checkout. We could look at some complex logic to use files
>> you have locally when they are not modified, and/or to get streaming in
>> place for this operation, but it will always be slower than when you
>> have local history.
>
>> -Rob
>
>
> Note that the change I made (and proposed) does handle streaming. Hence
> the 54 min => 9 min.
The repository iter_files_bytes api does not stream yet - it uses VFS
operations.
There will be some fat still to shave there if it does start streaming ;).
- -Rob
-----BEGIN PGP SIGNATURE----- enigmail. mozdev. org
n+6gACgkQ42zgmr PGrq7/kACcCqQ4V 06zwBhMCGAvy84k pMq8 Z8s1po6TRsgJxt/ Q9
Version: GnuPG v1.4.9 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://
iEYEARECAAYFAks
iBsAnjY8RGaxUeQ
=91m+
-----END PGP SIGNATURE-----