Comment 1 for bug 713832

Revision history for this message
William Deninger (wdeninger) wrote :

When mod priviledges are modified back to a typical 755, the extracted file "19950817 Fort Lauderdale 08.jpg" appears (image wise) as the first 75% of he original file. The lower 25% of the image is missing. So it seems that the last portion of the file has not been extracted.

I have identified the volume containing the failure The offending file
"19950817 Fort Lauderdale 08.jpg" exists across the volume boundary, spans 19
segments from th last part of vol582 into vol583. The first volume (vol582) produces a gpg fatal error. The second volume (vol583) does not (see below).

gpg --decrypt /media/Poodle/backup/media/MadDog/Archive/duplicity-full.20110205T061747Z.vol582.difftar.gpg > duplicity.difftar

You need a passphrase to unlock the secret key for
user: "First Last(Duplicity key) <email address hidden>"
2048-bit RSA key, ID 73B4F60A, created 2010-09-02 (main key ID 8ABB1A41)

gpg: gpg-agent is not available in this session
gpg: encrypted with 2048-bit RSA key, ID 73B4F60A, created 2010-09-02
      "FIrst Last(Duplicity key) <email address hidden>"
gpg: fatal: zlib inflate problem: incorrect data check
secmem usage: 2400/5440 bytes in 5/15 blocks of pool 5632/32768

When duplicity-full.20110205T061747Z.vol582.difftar.gpg
 is decrypted and extracted, the volume snapshot appears as:

.
.
.
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 07.jpg/22
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 07.jpg/23
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 07.jpg/24
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/1
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/2
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/3
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/4
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/5
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/6
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/7
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/8
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/9
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/10
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/11
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/12
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/13
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/14

The sequential volume duplicity-full.20110205T061747Z.vol583.difftar.gpg
(vol583):

gpg --decrypt /media/Poodle/backup/media/MadDog/Archive/duplicity-full.20110205T061747Z.vol583.difftar.gpg > duplicity.difftar

You need a passphrase to unlock the secret key for
user: "First Last(Duplicity key) <email address hidden>"
2048-bit RSA key, ID 73B4F60A, created 2010-09-02 (main key ID 8ABB1A41)

gpg: gpg-agent is not available in this session
gpg: encrypted with 2048-bit RSA key, ID 73B4F60A, created 2010-09-02
      "First Last(Duplicity key) <email address hidden>"
gpg: Signature made Fri 04 Feb 2011 10:50:42 PM PST using RSA key ID 8ABB1A41
gpg: Good signature from "First Last(Duplicity key) <email address hidden>"

When duplicity-full.20110205T061747Z.vol583.difftar.gpg
 is decrypted and extracted, the volume snapshot appears as:

multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/15
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/16
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/17
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/18
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/19
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 09.jpg/1
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 09.jpg/2
multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 09.jpg/3
.
.
.

So it appears that duplicity gives up and quits (even with ignore-errors enabled) when gpg produces the fatal error.

Also note that despite the error issued by gpg on vol582, extraction of the data from both vol582 and vol583 tar files following gpg decryption produces a complete and correct file.

root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/1" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/2" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/3" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/4" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/5" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/6" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/7" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/8" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/9" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/10" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/11" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/12" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/13" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/14" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/15" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/16" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/17" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/18" >> myphoto.jpg
root@SOUTH:~# cat "multivol_snapshot/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg/19" >> myphoto.jpg

root@SOUTH:~# md5sum myphoto.jpg
88adbf2eaf7285900edae10f35639eb0 /media/Poodle/myphoto.jpg
root@SOUTH:~# md5sum /media/MadDog/Archive/Photo\ Archive/1995/19950817\ Fort\ Lauderdale\ 08.jpg
88adbf2eaf7285900edae10f35639eb0 /media/MadDog/Archive/Photo Archive/1995/19950817 Fort Lauderdale 08.jpg

If there is a work-around for this, I would be most appreciative.

-W