codebrowse is hanging/unresponsive

thedac said at the time: "https://pastebin.canonical.com/68586/ we get these longer running branches but then they seem to go away"

I may be mistaken on the "same project" part. Some of the long-running threads from the thread dumps are from our nagios checks and the code doesn't change. Still investigating.

Note, I'm not able to get a page to load for the gcc tree, I'm guessing this is just 'loggerhead is slow' and it is slow enough that it is unable to preload its history cache for such a large branch. (namely this url always fails to load, but I'm unable to get any alternate URL of that branch to load either: http://bazaar.launchpad.net/%7Elinaro-toolchain-dev/gcc-linaro/4.5/revision/99503/gcc/testsuite/gcc.target/arm/neon/vst2_laneu8.c )

We have seen the timeout happen another couple of times. The common elment is the project: http://bazaar.launchpad.net/%7Emaria-captains/maria

thread-debug.1: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1-release/files/3091.1.2/vio/ 3.362637043 3.38897585869
thread-debug.2: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1/download/2992/sp1f-ignore-20001018235455-q4gxfbritt5f42nwix354ufpsvrf5ebj/.bzrignore 2.99768710136 2.99840116501
thread-debug.2: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1/view/2870/unittest/unit.pl 4.45497608185 4.46031498909
thread-debug.2: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1/files/2845/BitKeeper/ 7.46612000465 7.47808003426
thread-debug.2: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.3/files/3227/include/ 20.2567842007 20.2573421001
thread-debug.2: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1/view/2883/include/config-netware.h 7.62038111687 7.62871313095
thread-debug.3: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1/view/3034.1.4/Docs/glibc-2.2.5.patch 28.1828761101 28.1843152046
thread-debug.3: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.3/files/3133/BUILD/ 10.8758602142 10.8819770813
thread-debug.3: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.1/view/2872/sql/sp_cache.h 13.5343191624 13.5446372032
thread-debug.3: http://bazaar.launchpad.net/%7Emaria-captains/maria/5.3/files/3373/mysql-test/ 9.75973916054 9.80347108841

Core dump from when loggerhead was hung on carob:~dames/core.31162.bz2

So, this reflects:
 - performance and reliability issue within codebrowse.

We need to address it. The proximate triggering of it was a user
mirroring the codebrowse content as far as we can tell, which isn't an
intended use-case - they have been blocked to give us breathing spac.e