MemoryError when generating indexes
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
GNU Mailman |
New
|
Medium
|
Unassigned |
Bug Description
Vernier Networks has a relatively small/medium mailing
list archive (only ~238megs) that can not be
regenerated in 512megs of memory. (Once the machine
needs a reboot, this will increase to 1gig.) It dies
with a MemoryError supplied below:
Updating index files for archive [2002-May]
Traceback (most recent call last):
File "/home/
main()
File "/home/
archiver.
File "/home/
line 304, in close
self.
File "/home/
line 934, in update_
self.
File "/home/
line 513, in update_
self.
File "/home/
line 937, in update_archive
self.
File "/home/
line 417, in update_archive
self.
File "/home/
line 332, in __set_parameters
firstdate = self.database.
File
"/home/
207, in firstdate
self.
File
"/home/
238, in __openIndices
self.
File
"/home/
259, in __closeIndices
index.close()
File
"/home/
186, in close
fp.
MemoryError
and I also have an IOError on a lock file.
I will be looking at it, but since I do not know
Pipermail, I won't progress very far.
[http://
Found that in pipermail. T.processUnixMa ilbox, it will read
in ALL articles w/ their bodies attached. I have fixed
pipermail.Article to use an instance of a new class I wrote
for body. The class will emulate a simple sequence and an
interator object and just store the offsets to the lines,
and reread the lines as necessary. I'm waiting the nightly
run to see how things will go.
The patches currently work for small archives.