rsync: --xattrs is extremely slow
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
rsync (Ubuntu) |
New
|
Undecided
|
Unassigned |
Bug Description
Ubuntu 16.04 LTS repositories contain only rsync version 3.1.1:
$ apt policy rsync
rsync:
Installed: 3.1.1-3ubuntu1.2
Candidate: 3.1.1-3ubuntu1.2
Version table:
*** 3.1.1-3ubuntu1.2 500
500 http://
500 http://
100 /var/lib/
3.1.1-3ubuntu1 500
500 http://
However, this version has a bug where flag --xattrs causes very very high CPU usage if source contains lots of unique extended attributes. I'm trying to sync 13 TB (roughly 6.5 M files) with extended attributes and this bug seems to make this slower and slower as the time goes by. The system has been copying the stuff for three weeks (!) now. It's getting slower every day but still seems to make progress so I try to run it to completion. First couple of terabytes suggested that this sync operation should have taken around 4 days. The source directory is used by glusterfs which creates checksums as extended attributes and practically every file has different checksum.
Please, update rsync package on Ubuntu 16.04 to 3.1.2-2 or later.
See also: https:/
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: rsync 3.1.1-3ubuntu1.2
ProcVersionSign
Uname: Linux 4.15.0-
NonfreeKernelMo
ApportVersion: 2.20.1-0ubuntu2.18
Architecture: amd64
CurrentDesktop: MATE
Date: Tue Jul 2 09:07:49 2019
InstallationDate: Installed on 2015-02-23 (1589 days ago)
InstallationMedia: Ubuntu 14.04.2 LTS "Trusty Tahr" - Release amd64 (20150218.1)
SourcePackage: rsync
UpgradeStatus: Upgraded to xenial on 2016-06-10 (1116 days ago)
tags: | added: patch |
Note that this bug is NOT a duplicate of https:/ /bugs.launchpad .net/ubuntu/ +source/ rsync/+ bug/1524703