Project file uploads timeout (and often do not OOPS)

Bug #194558 reported by Brad Crittenden
178
This bug affects 24 people
Affects Status Importance Assigned to Milestone
Launchpad itself
Triaged
High
Unassigned
Linaro Infrastructure Misc
Invalid
High
Unassigned

Bug Description

A user reported problems uploading a 12MB file to the 'freevial' project and receiving no OOPS but instead:

"Please try again
Sorry, there was a problem connecting to the Launchpad server.
Try reloading this page in a minute or two. If the problem persists, let us know in the #launchpad IRC channel on Freenode.
Thanks for your patience."

Tom H. looked at the Apache logs and found:
https://pastebin.canonical.com/2732/

A search for others reporting the problem found:
http://issues.apache.org/bugzilla/show_bug.cgi?id=37770

The Apache server receives the fully uploaded file before passing it on to Launchpad. The upload died before finishing therefore there was no chance for an OOPS to be generated.

OOPS-6acb6414862499859f26aef311dc7bd3

Revision history for this message
Joey Stanford (joey) wrote :

Searching the logs, Tom has found a high number of instances of the error in the above pastebin.

There appears to be two issues at work here:

1) A possible apache issue causing (at least) upload failures

2) A lack of apache error log integration with our oops tools which allow us to detect these errors and correct them. Users instead see the unplanned-offline.html file with no OOPS generated to let us know there was actually an issue.

Revision history for this message
Christian Reis (kiko) wrote :

See bug #193062 for another case of OOPSes that look like apache timeouts.

Revision history for this message
William Grant (wgrant) wrote :

Any updates on this? People are complaining about it fairly often...

Curtis Hovey (sinzui)
affects: launchpad-foundations → launchpad-registry
Changed in launchpad-registry:
importance: Undecided → Low
status: New → Triaged
Revision history for this message
Albert Cervera i Areny - http://www.NaN-tic.com (albert-nan) wrote :

I'm having the same issue uploading a file of 40Mb in openobject-client-kde project. I've uploaded files that large in the past without problems. Anything I can do?

Revision history for this message
Curtis Hovey (sinzui) wrote :

A faster connection is about all that can be done, and that is not always an option. There can be connectivity issues between you and launchpad that may resolve themselves.

You could place the file in another public location (http or ftp), then set the filereleaseglob for the series find just the files you want to upload. The product-release-finder runs once a day and looks for files that match the glob. It will match the file name to the milestone and add the file for you.

Changed in launchpad:
importance: Low → Critical
tags: added: escalated linaro
removed: infrastructure lp-registry
Revision history for this message
Robert Collins (lifeless) wrote :

It may be easiest to fix this by moving uploads out of the zope appservers, which our infrastructure is not geared around supporting big uploads too. E.g. upload directly to the librarian, then register the content with LP (/handwave)

Revision history for this message
Abel Deuring (adeuring) wrote :

I could reproduce the problem when I truied to upload an ordinary Linux source code tarball to qastaging, using a somehwaht crappy mobile phone internet connection. The error occured around 1630..1640 UTC, 2011-09-26 (sorry, I did not watch the browser window closely enough to have a more precise time...) Problem: It seems that we don't get an OOPS report.

Revision history for this message
Abel Deuring (adeuring) wrote :

next attempt failed 2011-09-26, 1703UTC

Graham Binns (gmb)
Changed in launchpad:
assignee: nobody → Graham Binns (gmb)
Revision history for this message
Joey Ye (jinyun-ye) wrote :

Reproduce this bug by uploading a source tarball 130m in size. Time was about 1000UTC 2011-11-30

Revision history for this message
Andrew Stubbs (ams-codesourcery) wrote :

I'm getting the same problem trying to upload a 70MB file to the gcc-linaro project.

Joey Stanford (joey)
tags: added: arm
Revision history for this message
Robert Collins (lifeless) wrote :

Andrew succeeded using firefox from a different machine, was failing from chrome. May be irrelevant. Also reports a delay between the browser completing the upload and the error.

Graham Binns (gmb)
Changed in launchpad:
assignee: Graham Binns (gmb) → nobody
Revision history for this message
Jānis Kangarooo (kangarooo) wrote :

Maybe finally can timeout made longer waiting?

summary: - Project file uploads time-out but don't OOPS
+ Project file upload timeout (and often do not OOPS)
description: updated
Alexander Sack (asac)
Changed in linaro-infrastructure-misc:
milestone: none → backlog
importance: Undecided → High
status: New → Triaged
Revision history for this message
Markus Klyver (markusklyver) wrote : Re: Project file upload timeout (and often do not OOPS)

I get the HTTP 502 error message when trying to send >30 MiB bug reports.

William Grant (wgrant)
tags: added: webapp-infrastructure
Curtis Hovey (sinzui)
tags: removed: escalated
Changed in linaro-infrastructure-misc:
milestone: backlog → none
Revision history for this message
Curtis Hovey (sinzui) wrote :

This post has an example of use modporter to handle uploads: http://blog.jazkarta.com/2010/09/21/handling-large-files-in-plone-with-ore-bigfile/

Milo Casagrande (milo)
Changed in linaro-infrastructure-misc:
status: Triaged → Invalid
Lukasz (lukaszek130388)
Changed in launchpad:
status: Triaged → Fix Released
Colin Watson (cjwatson)
Changed in launchpad:
status: Fix Released → Triaged
Airkm (airkm)
information type: Public → Private
William Grant (wgrant)
information type: Private → Public
Colin Watson (cjwatson)
summary: - Project file upload timeout (and often do not OOPS)
+ Project file uploads timeout (and often do not OOPS)
Changed in launchpad:
importance: Critical → High
Revision history for this message
iram (mfcv) wrote (last edit ):

HTTP Error 502: Bad Gateway
While processing ubuntu-bug libinput10 in Jammy

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.