[trsync] Failed to create remote directory

Bug #1570260 reported by Dmitry Burmistrov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Max Rasskazov
Newton
Fix Committed
High
Max Rasskazov

Bug Description

In some cases tRsync failed to create remote directory.
If you create directory manually, tRsync do not create hardlinks to old snapshot.

Directory log:
$ trsync push $(pwd)/mos-repos/centos/mos9.0-centos7/os os -d rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7 -s os --init-directory-structure --timestamp 2016-04-14-123036
WARNING:safe_rsync.RsyncUrl:Rsync location "rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7" matches with 0 regexps: [].Please fail a bug on ... if it is wrong.
Rsync location "rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7" matches with 0 regexps: [].Please fail a bug on ... if it is wrong.
INFO:safe_rsync.TRsync.rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7:Using timestamp 2016-04-14-123036
Using timestamp 2016-04-14-123036
WARNING:safe_rsync.RsyncUrl:Rsync location "rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7/" matches with 0 regexps: [].Please fail a bug on ... if it is wrong.
Rsync location "rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7/" matches with 0 regexps: [].Please fail a bug on ... if it is wrong.
INFO:safe_rsync.RsyncRemote.rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7/:Creating directory "snapshots/"
Creating directory "snapshots/"
ERROR:safe_rsync.RsyncRemote.rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7/.Shell:"rsync -a -v --no-owner --no-group /tmp/tmpNQ_RLY/ rsync://localhost/mirror-sync/mos-repos/centos/mos9.0-centos7/" failed. Exit code == 11

STDOUT:
sending incremental file list

STDERR:
rsync: mkdir "/mos-repos/centos/mos9.0-centos7" (in mirror-sync) failed: No such file or directory (2)
rsync error: error in file IO (code 11) at main.c(674) [Receiver=3.1.0]

Tags: area-build
Changed in fuel:
milestone: none → 10.0
Changed in fuel:
status: New → In Progress
Roman Vyalov (r0mikiam)
tags: added: area-build
Revision history for this message
Ivan (iremizov) wrote :
Roman Vyalov (r0mikiam)
no longer affects: fuel/mitaka
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to infra/trsync (master)

Related fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21874

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Related fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21875

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Related fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21876

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Related fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21877

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Related fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21878

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Related fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21879

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to infra/trsync (master)

Fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21880

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to infra/trsync (master)

Related fix proposed to branch: master
Change author: Max Rasskazov <email address hidden>
Review: https://review.fuel-infra.org/21891

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix merged to infra/trsync (master)

Reviewed: https://review.fuel-infra.org/21874
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 492eb3c00e1a242feaf3218ab814baee489cbfa3
Author: Max Rasskazov <email address hidden>
Date: Thu Jun 9 09:59:42 2016

Implemented RsyncUrl.path_relative with tests

PEP8 fixes

Related-Bug: #1570260
Partial-Bug: #1575759
Change-Id: If3c1e5b4ad72b54f8585ab03588984fb5f8a4853

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Reviewed: https://review.fuel-infra.org/21875
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 67c6684cb96f3b257c7a03ba77cbfd598dec49bc
Author: Max Rasskazov <email address hidden>
Date: Thu Jun 9 11:54:59 2016

TempFiles fixes

Functional and PEP8

Related-Bug: #1570260
Partial-Bug: #1575759
Change-Id: I5397aad3f958d139697f941fe0107a95178f9d2e

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Reviewed: https://review.fuel-infra.org/21876
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 14409ee2b2e7cf07a85d36a5410aea4e378762a7
Author: Max Rasskazov <email address hidden>
Date: Thu Jun 9 11:54:59 2016

Base logger renamed and PEP8 fixes

Related-Bug: #1570260
Partial-Bug: #1575759
Change-Id: I2c37cf9800accf41f544fb257896ee712b2a7878

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Reviewed: https://review.fuel-infra.org/21877
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 0a16243e4bad2cc7d3480a993213b8e718bb98e5
Author: Max Rasskazov <email address hidden>
Date: Thu Jun 9 11:54:59 2016

Implemented basic class for functional tests

Functional tests uses rsyncd instances and file system
PEP8 fixes

Related-Bug: #1570260
Partial-Bug: #1575759
Change-Id: Id6533aba293b4a50be04967b68fb1827dec8141a

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Reviewed: https://review.fuel-infra.org/21891
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 5d7737fb69d6cd39d68a393be2b993349c9f7636
Author: Max Rasskazov <email address hidden>
Date: Thu Jun 9 11:54:59 2016

Fixed import in shell

Related-Bug: #1570260
Change-Id: I4a3e8f3b97c363d9faf22d655895bc0e523ca7f9

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Reviewed: https://review.fuel-infra.org/21878
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 376aab00b2aa2c3a30ef038a5e513a55ebf5d8c3
Author: Max Rasskazov <email address hidden>
Date: Wed Jun 15 11:43:16 2016

Basic rsync operations allocated to separated rsync_ops module

Functional tests implemented
PEP8 fixes

Related-Bug: #1570260
Partial-Bug: #1575759
Change-Id: I863658cebeae47e830591a1973ee1832a51e55e7

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote :

Reviewed: https://review.fuel-infra.org/21879
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 3ed87d225d39f7d306700d9f89d1027ff81d7f79
Author: Max Rasskazov <email address hidden>
Date: Wed Jun 15 11:43:16 2016

RsyncRemote refactored with functional tests

PEP8 fixes

Related-Bug: #1570260
Partial-Bug: #1575759
Change-Id: I4a44ca3e2134dd67b25a3b3f57edbd46d7e237ca

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to infra/trsync (master)

Reviewed: https://review.fuel-infra.org/21880
Submitter: Max Rasskazov <email address hidden>
Branch: master

Commit: 9f5e54eeff505387cc2bae0cee313c291179fc72
Author: Max Rasskazov <email address hidden>
Date: Wed Jun 15 11:55:26 2016

Refactored rsync_mirror.TRsync with functional tests

CLI tools updated according with API changes
PEP8 fixes

Closes-Bug: #1570260
Closes-Bug: #1575759
Change-Id: I26b3547854d670da2da94d469f88a3ea057f07db

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.