Activity log for bug #1541539

Date Who What changed Old value New value Message
2016-02-03 18:21:54 Alexander Kurenyshev bug added bug
2016-02-03 18:21:54 Alexander Kurenyshev attachment added fuel-snapshot-2016-02-03_18-19-08.tar.xz https://bugs.launchpad.net/bugs/1541539/+attachment/4563150/+files/fuel-snapshot-2016-02-03_18-19-08.tar.xz
2016-02-04 05:03:49 Nastya Urlapova fuel: importance Undecided High
2016-02-04 05:03:51 Nastya Urlapova fuel: status New Confirmed
2016-02-04 05:03:57 Nastya Urlapova nominated for series fuel/8.0.x
2016-02-04 05:03:57 Nastya Urlapova bug task added fuel/8.0.x
2016-02-04 05:03:57 Nastya Urlapova nominated for series fuel/mitaka
2016-02-04 05:03:57 Nastya Urlapova bug task added fuel/mitaka
2016-02-04 05:04:05 Nastya Urlapova fuel/8.0.x: milestone 8.0
2016-02-04 05:04:08 Nastya Urlapova fuel/mitaka: milestone 8.0 9.0
2016-02-04 05:04:22 Nastya Urlapova fuel/8.0.x: assignee Fuel Library Team (fuel-library)
2016-02-04 05:04:25 Nastya Urlapova fuel/8.0.x: importance Undecided High
2016-02-04 05:04:29 Nastya Urlapova fuel/8.0.x: status New Confirmed
2016-02-04 05:04:33 Nastya Urlapova fuel/mitaka: status Confirmed New
2016-02-04 08:58:46 Dmitry Klenov fuel/mitaka: status New Confirmed
2016-02-04 09:30:08 Bogdan Dobrelya tags area-python
2016-02-04 09:31:03 Bogdan Dobrelya fuel/8.0.x: status Confirmed Won't Fix
2016-02-04 09:31:06 Bogdan Dobrelya fuel/8.0.x: importance High Medium
2016-02-04 09:31:07 Bogdan Dobrelya fuel/mitaka: importance High Medium
2016-02-04 09:46:35 Nastya Urlapova fuel/8.0.x: importance Medium High
2016-02-04 09:46:38 Nastya Urlapova fuel/mitaka: importance Medium High
2016-02-04 09:46:41 Nastya Urlapova fuel/8.0.x: status Won't Fix Confirmed
2016-02-04 11:03:56 Matthew Mosesohn fuel/8.0.x: assignee Fuel Library Team (fuel-library) Fuel Python Team (fuel-python)
2016-02-04 11:04:00 Matthew Mosesohn fuel/mitaka: assignee Fuel Library Team (fuel-library) Fuel Python Team (fuel-python)
2016-02-04 13:29:18 Alexander Kurenyshev attachment added fail_error_ha_one_controller_backup_restore_diagnostic-logs_2016_02_04__04_59_23.tgz https://bugs.launchpad.net/fuel/+bug/1541539/+attachment/4563754/+files/fail_error_ha_one_controller_backup_restore_diagnostic-logs_2016_02_04__04_59_23.tgz
2016-02-04 14:19:41 OpenStack Infra fuel: status Confirmed In Progress
2016-02-04 14:19:41 OpenStack Infra fuel: assignee Fuel Python Team (fuel-python) Matthew Mosesohn (raytrac3r)
2016-02-04 14:50:57 Matthew Mosesohn summary Node is still presented after restoring of backup docker backup sometimes is corrupt and cannot be restored
2016-02-04 14:51:00 Matthew Mosesohn fuel/8.0.x: importance High Medium
2016-02-04 14:51:03 Matthew Mosesohn fuel/8.0.x: status Confirmed Won't Fix
2016-02-04 14:51:09 Matthew Mosesohn fuel/mitaka: importance High Medium
2016-02-04 14:51:12 Matthew Mosesohn fuel/8.0.x: assignee Fuel Python Team (fuel-python) Matthew Mosesohn (raytrac3r)
2016-02-04 14:51:41 Matthew Mosesohn description Found on CI: https://product-ci.infra.mirantis.net/view/8.0_swarm/job/8.0.system_test.ubuntu.backup_restore_master/126/console Test steps: 1. Revert snapshot "deploy_ha_one_controller_backup_restore" 2. Backup master 3. Check backup 4. Run OSTF 5. Add 1 node with compute role 6. Restore master 7. Check restore 8. Run OSTF Initial snapshot includes two nodes. So after snapshot's restoring there should be 2 nodes after step 6. But we have 3 nodes: 1 is pending addition. [root@nailgun ~]# fuel node id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id ---|----------|---------------------|---------|-------------|-------------------|------------|---------------|--------|--------- 1 | ready | slave-01_controller | 1 | 10.109.20.3 | 64:54:dd:68:40:b5 | controller | | True | 1 2 | discover | slave-03_compute | 1 | 10.109.20.5 | 64:b2:c3:85:38:c6 | | compute | True | 1 3 | ready | slave-02_compute | 1 | 10.109.20.4 | 64:7b:ba:9d:49:aa | compute | | True | 1 Fuel used: feature_groups: - mirantis production: "docker" release: "8.0" api: "1.0" build_number: "515" build_id: "515" fuel-nailgun_sha: "c363c742bf3a7e7881239c8819ff5c6622f90625" python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5" fuel-agent_sha: "658be72c4b42d3e1436b86ac4567ab914bfb451b" fuel-nailgun-agent_sha: "b2bb466fd5bd92da614cdbd819d6999c510ebfb1" astute_sha: "b81577a5b7857c4be8748492bae1dec2fa89b446" fuel-library_sha: "4a783e271a0c4b889d16b66dd8410766b2b00813" fuel-ostf_sha: "5fe41945c2a49f26c849df1fd46329f6db1ab6b0" fuel-mirror_sha: "eea143f2c6ed91dcaf55bc0911677f6fdc5a9133" fuelmenu_sha: "12227354aec1d38f7f51042df64cca59fa7a95f1" shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906" network-checker_sha: "a43cf96cd9532f10794dce736350bf5bed350e9d" fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b" fuelmain_sha: "c5aac6c0b8d2a37147fdd6e6b78df4ad2ad90e31" Something is wrong with restore operation, it has returned code 1, reproduced on CI https://product-ci.infra.mirantis.net/job/8.0.system_test.ubuntu.backup_restore_master/127/console Exception: Unexpected exit_code returned: actual 1, expected 0. Command: 'dockerctl restore /var/backup/fuel/backup_2016-02-04_0438/fuel_backup_2016-02-04_0438.tar.lrz ' Details: {'host': '10.109.25.2', 'command': 'dockerctl restore /var/backup/fuel/backup_2016-02-04_0438/fuel_backup_2016-02-04_0438.tar.lrz\n', 'exit_code': 1, 'stderr': ['\n', 'Restore failed!\n'], 'stdout': ['Stopping containers...\n', 'Stopping nginx...\n', 'Stopping rabbitmq...\n', 'Stopping astute...\n', 'Stopping rsync...\n', 'Stopping keystone...\n', 'Stopping postgres...\n', 'Stopping rsyslog...\n', 'Stopping nailgun...\n', 'Stopping cobbler...\n', 'Stopping ostf...\n', 'Stopping mcollective...\n', 'Output filename is: /var/backup/fuel/restore-2016-02-04_0438//fuel_backup.tar\n', 'Decompressing...\n', ' 10% 743.42 / 7433.99 MB\r 20% 1486.82 / 7433.99 MB\r 25% 1898.91 / 7433.99 MB\r 30% 2230.22 / 7433.99 MB\r 40% 2973.60 / 7433.99 MB\r 50% 3717.02 / 7433.99 MB\r 51% 3797.70 / 7433.99 MB\r 60% 4460.42 / 7433.99 MB\r 70% 5203.85 / 7433.99 MB\r 76% 5696.61 / 7433.99 MB\r 80% 5947.23 / 7433.99 MB\r 90% 6690.65 / 7433.99 MB\r100% 7433.99 / 7433.99 MB\r\n', 'Average DeCompression Speed: 45.323MB/s\n', 'MD5 CHECK FAILED.\n', 'Stored:cc4b50cab33e62354bb312e514d7f585\n', 'Output file:2f2895074ec5b268a300275008f537f9Fatal error - exiting\n']}
2016-02-05 09:22:03 OpenStack Infra fuel: status In Progress Fix Committed
2016-02-15 10:42:37 Matthew Mosesohn fuel/mitaka: status Fix Committed Confirmed
2016-02-15 10:42:40 Matthew Mosesohn fuel/8.0.x: status Won't Fix Confirmed
2016-02-15 10:42:44 Matthew Mosesohn fuel/8.0.x: milestone 8.0 8.0-updates
2016-02-15 10:42:47 Matthew Mosesohn fuel/mitaka: status Confirmed Invalid
2016-02-15 10:48:00 Matthew Mosesohn fuel/8.0.x: assignee Matthew Mosesohn (raytrac3r) MOS Linux (mos-linux)
2016-02-15 10:48:06 Matthew Mosesohn fuel/mitaka: assignee Matthew Mosesohn (raytrac3r) MOS Linux (mos-linux)
2016-02-15 10:48:27 Matthew Mosesohn tags area-python area-linux docker
2016-02-17 11:22:39 Nastya Urlapova fuel/mitaka: importance Medium High
2016-02-17 11:22:42 Nastya Urlapova fuel/8.0.x: importance Medium High
2016-03-04 22:00:26 Dmitry Teselkin fuel/mitaka: assignee MOS Linux (mos-linux) Fuel Library Team (fuel-library)
2016-03-04 22:00:43 Dmitry Teselkin fuel/8.0.x: assignee MOS Linux (mos-linux) Fuel Library Team (fuel-library)
2016-05-06 13:25:11 Vadim Rovachev fuel/8.0.x: assignee Fuel Library (Deprecated) (fuel-library) MOS Puppet Team (mos-puppet)
2016-05-06 13:29:12 Vadim Rovachev tags area-linux docker area-linux area-puppet docker
2016-07-18 10:28:04 Vitaly Sedelnik fuel/8.0.x: milestone 8.0-updates 8.0-mu-3
2016-07-27 11:13:58 Vadim Rovachev nominated for series fuel/6.1.x
2016-07-27 11:13:58 Vadim Rovachev bug task added fuel/6.1.x
2016-07-27 11:14:23 Vadim Rovachev fuel/6.1.x: milestone 6.1-updates
2016-07-27 13:02:23 Vitaly Sedelnik fuel/6.1.x: status New Confirmed
2016-07-27 13:02:26 Vitaly Sedelnik fuel/6.1.x: importance Undecided High
2016-07-27 13:02:34 Vitaly Sedelnik fuel/6.1.x: assignee MOS Maintenance (mos-maintenance)
2016-08-15 09:57:16 Denis Puchkin fuel/8.0.x: assignee MOS Puppet Team (mos-puppet) Denis Puchkin (dpuchkin)
2016-08-15 09:57:19 Denis Puchkin fuel/8.0.x: status Confirmed Fix Committed
2016-09-09 11:57:20 Vladimir Jigulin fuel/8.0.x: status Fix Committed Fix Released
2016-09-21 09:40:14 Alexey Stupnikov nominated for series fuel/7.0.x
2016-09-21 09:40:14 Alexey Stupnikov bug task added fuel/7.0.x
2016-09-21 09:40:26 Alexey Stupnikov fuel/7.0.x: importance Undecided High
2016-09-21 09:40:31 Alexey Stupnikov fuel/7.0.x: assignee Alexey Stupnikov (astupnikov)
2016-09-21 09:40:35 Alexey Stupnikov fuel/7.0.x: milestone 7.0-updates
2016-09-21 09:46:25 Alexey Stupnikov fuel/6.1.x: assignee MOS Maintenance (mos-maintenance) Alexey Stupnikov (astupnikov)
2016-10-13 09:51:24 Alexey Stupnikov fuel/7.0.x: status New Invalid
2016-10-13 12:04:51 Alexey Stupnikov fuel/6.1.x: status Confirmed Invalid