Comment 9 for bug 1729695

Revision history for this message
Kenneth Loafman (kenneth-loafman) wrote : Re: [Bug 1729695] Re: ASCII decode error, but not due to filenames in backup target

Take a look at the message in duplicity-team called "Help with unicode
branch (for Python3 support)".

It turns out that uexc() is using ufn() which is calling
sys.getfilesystemencoding(). We may have a fix, not implemented yet, for
sys.getfilesystemencoding() returning 'ascii' or None when called in a
detached process. Would like your thoughts on that.

On Sun, Nov 19, 2017 at 10:42 AM, Michael Terry <email address hidden> wrote:

> Actually, that looks like what is happening — an error is bubbling up
> from the system and when trying to format it, duplicity is misconverting
> from/to Unicode and crashing. Possibly due to a translation.
>
> Reassigning to duplicity and myself.
>
> ** Package changed: deja-dup (Ubuntu) => duplicity (Ubuntu)
>
> ** Also affects: duplicity
> Importance: Undecided
> Status: New
>
> ** Changed in: duplicity
> Assignee: (unassigned) => Michael Terry (mterry)
>
> --
> You received this bug notification because you are subscribed to
> duplicity in Ubuntu.
> https://bugs.launchpad.net/bugs/1729695
>
> Title:
> ASCII decode error, but not due to filenames in backup target
>
> Status in Duplicity:
> New
> Status in duplicity package in Ubuntu:
> Confirmed
>
> Bug description:
> On Ubuntu 17.10, I have deja-dup 36.2-0ubuntu1 installed. When I run
> "DEJA_DUP_DEBUG=1 deja-dup", it starts a backup as soon as it opens,
> as expected. But the backup fails. I get the following at the end of
> the output. I tried uninstalling Dropbox and deleting its .dropbox-
> dist directory, and then deja-dup crashed when trying to back up a
> completely different file (but the same byte in the same position). So
> I don't think this is due to any of the filenames I have in my backup
> target. I also tried a few commands to find non-ASCII filenames, with
> no luck. I'm not sure what else I can do to troubleshoot.
>
>
> DUPLICITY: INFO 4 'home/paul/.dropbox-dist/dropbox-lnx.x86_64-38.4.27/
> PyQt5.QtGui.so'
> DUPLICITY: . A home/paul/.dropbox-dist/dropbox-lnx.x86_64-38.4.27/PyQ
> t5.QtGui.so
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /home/paul/.cache/deja-dup/1499b6292f58faddd30853ffbbfefc
> f6/duplicity-S72EWc-tempdir/mktemp-hYd54u-1
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /home/paul/.cache/deja-dup/1499b6292f58faddd30853ffbbfefc
> f6/duplicity-VyBN42-tempdir/mktemp-BO1DKJ-1
>
> DUPLICITY: INFO 11
> DUPLICITY: . AsyncScheduler: running task synchronously (asynchronicity
> disabled)
>
> DUPLICITY: INFO 1
> DUPLICITY: . Writing duplicity-full.20171102T205615Z.vol1.difftar.gz
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Releasing lockfile /home/paul/.cache/deja-dup/
> 1499b6292f58faddd30853ffbbfefcf6/lockfile.lock
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /tmp/duplicity-c9BMvB-tempdir/mktemp-RtijDc-270
>
> DUPLICITY: DEBUG 1
> DUPLICITY: . Removing still remembered temporary file
> /tmp/duplicity-c9BMvB-tempdir/mkstemp-3cxG5G-1
>
> DUPLICITY: ERROR 30 UnicodeDecodeError
> DUPLICITY: . Traceback (most recent call last):
> DUPLICITY: . File "/usr/bin/duplicity", line 1546, in <module>
> DUPLICITY: . with_tempdir(main)
> DUPLICITY: . File "/usr/bin/duplicity", line 1540, in with_tempdir
> DUPLICITY: . fn()
> DUPLICITY: . File "/usr/bin/duplicity", line 1391, in main
> DUPLICITY: . do_backup(action)
> DUPLICITY: . File "/usr/bin/duplicity", line 1510, in do_backup
> DUPLICITY: . full_backup(col_stats)
> DUPLICITY: . File "/usr/bin/duplicity", line 575, in full_backup
> DUPLICITY: . globals.backend)
> DUPLICITY: . File "/usr/bin/duplicity", line 456, in write_multivol
> DUPLICITY: . (tdp, dest_filename, vol_num)))
> DUPLICITY: . File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py",
> line 146, in schedule_task
> DUPLICITY: . return self.__run_synchronously(fn, params)
> DUPLICITY: . File "/usr/lib/python2.7/dist-packages/duplicity/asyncscheduler.py",
> line 172, in __run_synchronously
> DUPLICITY: . ret = fn(*params)
> DUPLICITY: . File "/usr/bin/duplicity", line 455, in <lambda>
> DUPLICITY: . vol_num: put(tdp, dest_filename, vol_num),
> DUPLICITY: . File "/usr/bin/duplicity", line 344, in put
> DUPLICITY: . backend.put(tdp, dest_filename)
> DUPLICITY: . File "/usr/lib/python2.7/dist-
> packages/duplicity/backend.py", line 376, in inner_retry
> DUPLICITY: . % exception_traceback())
> DUPLICITY: . File "/usr/lib/python2.7/dist-packages/duplicity/util.py",
> line 52, in exception_traceback
> DUPLICITY: . return uexc(msg)
> DUPLICITY: . File "/usr/lib/python2.7/dist-packages/duplicity/util.py",
> line 80, in uexc
> DUPLICITY: . e = unicode(e).encode('utf-8')
> DUPLICITY: . UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in
> position 736: ordinal not in range(128)
> DUPLICITY: .
>
> ProblemType: Bug
> DistroRelease: Ubuntu 17.10
> Package: deja-dup 36.2-0ubuntu1
> ProcVersionSignature: Ubuntu 4.13.0-16.19-generic 4.13.4
> Uname: Linux 4.13.0-16-generic x86_64
> NonfreeKernelModules: nvidia_uvm nvidia_drm nvidia_modeset nvidia
> ApportVersion: 2.20.7-0ubuntu3.1
> Architecture: amd64
> CurrentDesktop: ubuntu:GNOME
> Date: Thu Nov 2 17:46:56 2017
> InstallationDate: Installed on 2017-07-02 (123 days ago)
> InstallationMedia: Ubuntu 17.04 "Zesty Zapus" - Release amd64 (20170412)
> ProcEnviron:
> TERM=xterm-256color
> PATH=(custom, no user)
> XDG_RUNTIME_DIR=<set>
> LANG=en_US.UTF-8
> SHELL=/bin/bash
> SourcePackage: deja-dup
> UpgradeStatus: Upgraded to artful on 2017-10-22 (11 days ago)
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/duplicity/+bug/1729695/+subscriptions
>