make static html versions of jenkins reports for archiving

Bug #1034032 reported by James E. Blair
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Core Infrastructure
Fix Released
Critical
Unassigned

Bug Description

Too many archived builds slows jenkins down (as it reads all of the xml files from disk, parses them, and keeps them in memory). Web servers are fast. So let's generate static versions of the important jenkins reports and logs, and archive them onto a web server, and tell Jenkins to keep fewer jobs in the build history. This will entail:

* Writing a script to generate a static HTML report from nosetests.xml.
* Finding a way (maybe another script) to get the console log as a file. Preferably with timestamps.
* Switching the coverage jobs to just produce HTML natively.
* Uploading these and any other logs (like devstack logs) to a web server.

The files can be uploaded to a predictable directory, such as "/job-name/job-number/" and then Zuul can be reconfigured to link directly to that URL instead of Jenkins.

Tags: jenkins
Revision history for this message
James E. Blair (corvus) wrote :

Additional motivation: the junit test result collection in jenkins is serialized, meaning that frequently a build that is finished is waiting on an earlier build of the same job to finish so that it's junit results are collected in order. Sometimes this even results in a global deadlock if the earlier build is stuck (and we've seen it get stuck even though it has a timeout set).

Revision history for this message
James E. Blair (corvus) wrote :

AND, it means that jobs in unrelated zuul queues (like the check queue) can end up holding up the gate queue, or vice versa.

James E. Blair (corvus)
Changed in openstack-ci:
status: Triaged → Fix Released
milestone: none → folsom
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.