Activity log for bug #796997

Date Who What changed Old value New value Message
2011-06-14 03:35:03 Steve Kowalik bug added bug
2011-06-14 03:35:39 Steve Kowalik description The contents generation as it currently stands is only done for the Ubuntu PRIMARY archive, shares a lock file with the publisher, and takes an hour or more. It needs to die horribly. The rest of this bug report is a brain-dump of my current thought process about this. This can be fixed iterably, by first creating a table (say, BinaryPackageContents), that contains a bpn id, das id, archive, filename. I have not given much thought to indexing this table, sadly. The second step would be to write a garbo script that iterates over published BPRs with no expired BPRFs and adds rows to BPC. Expect run time is a week, perhaps less, since unlike PSC, we don't need to extract the source. We can grab the .deb from the librarian, run dpkg-deb -c over it, and parse the output. The third step would be to hook into the publisher to create and delete rows from BPC when it marks a BPR as SUPERSEDED or PUBLISHED. We may also need to do some trickery in terms of deletion of binary packages. The four step would be to write a hook script for the publisher that generates the contents file for a given archive, and turn off the cronscript for the current script. The contents generation as it currently stands is only done for the Ubuntu PRIMARY archive, shares a lock file with the publisher, and takes an hour or more. It needs to die horribly. The rest of this bug report is a brain-dump of my current thought process about this. This can be fixed iterably, by first creating a table (say, BinaryPackageContents), that contains a bpn id, das id, archive, filename. I have not given much thought to indexing this table, sadly. The second step would be to write a garbo script that iterates over published BPRs with no expired BPRFs and adds rows to BPC. Expect run time is a week, perhaps less, since unlike PSC, we don't need to extract the source. We can grab the .deb from the librarian, run dpkg-deb -c over it, and parse the output. The third step would be to hook into the publisher to create and delete rows from BPC when it marks a BPR as SUPERSEDED or PUBLISHED. We may also need to do some trickery in terms of deletion of binary packages. The fourth step would be to write a hook script for the publisher that generates the contents file for a given archive, and turn off the cronscript for the current script.
2011-06-14 04:06:56 William Grant launchpad: status Confirmed Triaged
2011-06-14 04:07:01 William Grant tags soyuz soyuz-publish
2011-06-16 05:40:21 Steve Kowalik branch linked lp:~stevenk/launchpad/db-add-bprc
2011-06-21 21:52:30 Launchpad QA Bot launchpad: assignee Steve Kowalik (stevenk)
2011-06-21 21:52:31 Launchpad QA Bot tags soyuz-publish qa-needstesting soyuz-publish
2011-06-21 21:52:33 Launchpad QA Bot launchpad: status Triaged In Progress
2011-06-22 02:07:08 Steve Kowalik tags qa-needstesting soyuz-publish qa-untestable soyuz-publish
2011-07-27 09:12:43 Steve Kowalik branch linked lp:~stevenk/launchpad/populate-bprc
2012-10-31 01:58:10 Steve Kowalik launchpad: status In Progress Triaged
2012-10-31 01:58:13 Steve Kowalik launchpad: assignee Steve Kowalik (stevenk)