Downloading files from librarian should be asynchronous
Bug #241646 reported by
Celso Providelo
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
launchpad-buildd |
Triaged
|
Low
|
Unassigned |
Bug Description
The current code uses urllib2.urlopen() which is blocking and become a problem for huge original tarball (OO, for instance). It sometimes takes longer than 120s (current timeout) in our gigabit network.
The only safe way to solve this problem is to use a asynchronous approach to download the files, similarly to what we have done in bug 211974.
The code surrounding BuildDSlave.
Once it's done we will be able to reduce the timeout value drastically, since the lp-buildd will operate almost entirely asynchronously.
description: | updated |
Changed in launchpad-buildd: | |
importance: | Medium → High |
To post a comment you must log in.
There is less pressure on this aspect now that the master side is asynchronous, but it is still desirable.