since oneiric ocelot wget mirror with -c -N option leads to memory exhaustion
| Affects | Status | Importance | Assigned to | Milestone | |
|---|---|---|---|---|---|
| wget (Ubuntu) |
Confirmed
|
Undecided
|
Unassigned | ||
Bug Description
i try to mirror a public server. i interrupt the download and continue later.
somehow wget gets slow overally comparing the sizes and continuing a session used to be lightning fast. now it slows down.
also for some files or large sets of files it already downloaded before it somehow at some point just suddenly spikes the memory usage (visible at the system load indicators) and then it terminates telling something like 'memory exhausted'
so maybe this is caused somewhere in the decision logic where wget keeps the files it already found in memory.
maybe someone can reproduce this. i see this on a 32 bit system. wget version is 1.12 if i remember correctly.
mirror a site with the options --mirror -c (continue partial downloads) and -N (timestamp checking)
interrupt and continue. sometimes this happens. most of the time it doesn't. but when the session got to a point when it failed once it will fail again at the same stage.
| Launchpad Janitor (janitor) wrote | #1 |
| Changed in wget (Ubuntu): | |
| status: | New → Confirmed |
| Dennis (dennis.guse) wrote | #2 |
Status changed to 'Confirmed' because the bug affects multiple users.