Launchpad itself

tasks queued for the launchpad build farm can be starved out by bulk work, and bulk work can be starved by interactive work

Bug #810720 reported by Francis J. Lacoste
44
This bug affects 7 people
Affects Status Importance Assigned to Milestone
Launchpad itself
Triaged
High
Unassigned

Bug Description

The current score-based queued algorithm is pretty primitive. We want to be able to better segment the build resources across our users. We would like also to be able to provide strict SLA to certain class of users, while at the same time ensuring that no builds is ever starved.

Some (but not exhaustive use cases):
 * We want time-sensitive Ubuntu rebuilds to progress rapidly while not hogging the build farm from other users.
 * We want to provide strict SLA for commercial sensitive builds (Landscape, OEM, etc.)
 * etc.

This needs to be turned into a proper LEP, but is a reminder to do so.

Revision history for this message
Julian Edwards (julian-edwards) wrote :

In the ideal world this would turn into something that has dynamic weightings controlled from a page in LP that has a lot of knobs and dials. For example, we might want to weight rebuilds more heavily, turn down a PPA that has a lot of builds swamping the farm, or temporarily promote language packs. There are a lot of variables.

Revision history for this message
Robert Collins (lifeless) wrote :

There are, but we shouldn't *need* to fiddle on a daily basis!

tags: added: canonical-losa-lp
summary: - Improve queueing algorithm in build farm
+ launchpad build farm queuing is not fair
Revision history for this message
Julian Edwards (julian-edwards) wrote : Re: launchpad build farm queuing is not fair

Need daily, no. Require sometimes, yes.

BTW I really dislike the words "not fair" that you've changed in the title, it reminds me of school playground disputes. Fairness is very subjective.

summary: - launchpad build farm queuing is not fair
+ Improve queuing algorithm in build farm
Revision history for this message
Robert Collins (lifeless) wrote : Re: Improve queuing algorithm in build farm

I'm sorry you don't like it, and I'd love a replacement. However, this bug won't be done if we just improve it; the specific thing we need to aim for is fairness; be that weighted or not.

I'm going to change it back, though I'll add quotes around 'fair' to emphasis it.

summary: - Improve queuing algorithm in build farm
+ launchpad build farm queuing is not 'fair'
Revision history for this message
Robert Collins (lifeless) wrote : Re: launchpad build farm queuing is not 'fair'

Actually, I'll just make it more verbose about the problems, that will help non network-engineery/statisticians anyhow.

summary: - launchpad build farm queuing is not 'fair'
+ tasks queued for the launchpad build farm can be starved out by bulk
+ work, and bulk work can be starved by interactive work
Revision history for this message
Julian Edwards (julian-edwards) wrote :

That is much, much better, thank you.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.