Malone connection generates an "Internal Server Error" on large file attachments

Bug #95822 reported by Sam Williams
50
This bug affects 6 people
Affects Status Importance Assigned to Milestone
Launchpad itself
Triaged
High
jsdainty@gmail.com
apport (Ubuntu)
Confirmed
Medium
Unassigned

Bug Description

while working to get the crash report uploaded for bug #94882 I tried twice to upload the crash file as an attachment to an error report and each time the transfer process resulted in the generation of a "500 Internal Server Error". The file in question was first sent as a large packed text file of approximately 130 mbytes in size. After about 30 minutes of uploading the error was produced. I then used bzip2 to compress it down to approximately 90 mbytes. When transferring the file as an attachment I encountered the same error.

Retransmitting the file would have not been necessary, except during the initial automatic upload of the crash report the process died with only part of the file making it to Malone Since the only component not fully transferred was the CoreDump file I used apport-unpack to extract it. I then ran bzip2 to reduce its size down to about 85 mbytes. The bzip CoreDump file was then successfully loaded to the site.

So in summary, a file of 130 Mbytes produced an error, a file of 90 mbytes produced an error, but a file of about 85 mbytes was transferred without issue.

Revision history for this message
Marco Rodrigues (gothicx) wrote :

I can confirm this one too... on apport 0.95

Changed in apport:
status: New → Confirmed
Changed in apport:
importance: Undecided → Medium
Revision history for this message
Martin Pitt (pitti) wrote :

Malone hackers, is there a particular limit on the file size? Should I clip this in apport?

Changed in malone:
status: New → Incomplete
Changed in malone:
status: Incomplete → New
Revision history for this message
Björn Tillenius (bjornt) wrote :

Is this still happening? I haven't see any OOPSes related to this lately.

Changed in malone:
status: New → Incomplete
Revision history for this message
Fernando Miguel (fernandomiguel) wrote :

Bjorn yes it is.

Changed in malone:
status: Incomplete → New
Revision history for this message
Diogo Matsubara (matsubara) wrote :

Bjorn, this seems to be the bug that kiko and niemeyer have been investigating lately. The one that about app server dying. I'm subscribing both kiko and niemeyer so they can give us more info about the debugging done last week where they sucessfully reproduced this bug.

This issue was also discussed during out LP production meeting: http://pastebin.ubuntu.com/55691/. Tom Berger will discuss with the Bugs team if it's possible to find a quick workaround.

Changed in malone:
importance: Undecided → High
status: New → Triaged
Revision history for this message
Shirish Agarwal (shirishag75) wrote :

Hi all,
 I have been effected by this as well, hence have had an aversion to file crasher bugs, and no not 150 MB or MiB file sized, even 5-10 MB/MiB file sizes sometimes doesn't go through.

And as a user neither do I have the technical skills involved nor the tenacity to go the extra mile to know how much and where it got sent and how much is remaining to be sent. It should just work :(

Revision history for this message
Diogo Matsubara (matsubara) wrote :

Bjorn is fixing this by using a new parser for apport blobs. It's currently under review by Gavin.

Revision history for this message
LimCore (limcore) wrote :

Today (2008-10-18 ~ 9:00 GTM+2) I got an:
HTTP Error 502: Bad Gateway
when uploading a large crash (15 mb.. or was it 151 mb? see #92653).
I am not behind proxy or anything strange.
It is possible that package (xorg) was already out of date (see #122818)

Revision history for this message
Shirish Agarwal (shirishag75) wrote :

What I would suggest is if this could be accomplished by having some library abstracted which could be perhaps re-used by other applications where lot of data needs to be sent to the server (say to some file-sharing site or something) .

Another cool thing if there is a possibility of upload-resuming, I don't know if its possible or not but it would be cool if something like this could be accomplished.

Looking forward for comments and suggestions on the same.

Revision history for this message
Diogo Matsubara (matsubara) wrote :

Reproduced this one today by trying to upload a 100M file to staging. Here are my live http headers capture of the POST issued: http://pastebin.ubuntu.com/261145/

Bjorn, what else can I do to help debug this problem?

Changed in malone:
assignee: nobody → jsdainty@gmail.com (jsdainty)
Tom Haddon (mthaddon)
tags: added: canonical-losa-lp
Revision history for this message
Jamin W. Collins (jcollins) wrote :

I'm also seeing this with both manual and automatic uploads of kernel crash dumps.

Revision history for this message
Gary Poster (gary) wrote :

For someone who can reproduce the problem and is comfortable mucking with the reporting script, it might be useful to add the following to the top of the apport reporting script.

import httplib2
httplib2.debuglevel=1

After this, the next run will print a lot of debugging information that might give us more information on what is timing out. That might help analysis of the problem.

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

I have this problem with Apport (I don't know what is malone), on Lucid 64bits.
Half of the crashes I want to report end with this message :
"Cannot connect to crash database, please check your Internet connection.

HTTP Error 500: Internal Server Error"

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

Here is a crash report I can't report with apport : http://scenari.utc.fr/~loa/temp/_usr_bin_evolution.1001.crash

Revision history for this message
Jamin W. Collins (jcollins) wrote :

@Loïc Alejandro:
You should be able to retrace the crash dump yourself using apport-retrace. You can then upload the retrace output to a bug report.

Revision history for this message
Alexandros Papadopoulos (alexandros-papadopoulos) wrote :

Bitten by same bug consistently yesterday - it was impossible to upload a tiny bug report (9KB).

A workaround seems to be by dumping the output to a local file with

$ apport-cli -f -p <package name>

...and then sending the report file with

$ ubuntu-bug report.apport

Using fully up to date.Lucid.

-A

Revision history for this message
Robert Collins (lifeless) wrote :

This is a dupe with the issue uploading large relase files I think. I don't have the bug number handy for that.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.