[library]Replace exist HA controller node with new one cause deploy error

Bug #1384089 reported by Chang-Yi Lee
14
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Stanislaw Bogatkin

Bug Description

 Environment
----------------------

{"ostf_sha": "64cb59c681658a7a55cc2c09d079072a41beb346", "auth_required": true, "api": "1.0", "nailgun_sha": "f9d910156f6a88bcb831424143d084036ee3e8dd", "production": "docker", "fuelmain_sha": "30a4545d6105339f66cfc845c4c50df5932f0da4", "astute_sha": "f5fbd89d1e0e1f22ef9ab2af26da5ffbfbf24b13", "feature_groups": ["experimental"], "release": "5.1", "release_versions": {"2014.1.1-5.1": {"VERSION": {"ostf_sha": "64cb59c681658a7a55cc2c09d079072a41beb346", "api": "1.0", "nailgun_sha": "f9d910156f6a88bcb831424143d084036ee3e8dd", "production": "docker", "fuelmain_sha": "30a4545d6105339f66cfc845c4c50df5932f0da4", "astute_sha": "f5fbd89d1e0e1f22ef9ab2af26da5ffbfbf24b13", "feature_groups": ["experimental"], "release": "5.1", "fuellib_sha": "d9b16846e54f76c8ebe7764d2b5b8231d6b25079"}}}, "fuellib_sha": "d9b16846e54f76c8ebe7764d2b5b8231d6b25079"}

[Operating System]
    Ubuntu 12.04

[Reference Architecture]
    HA without Ceph

[Network model ]
    Nova-network

[Related Projects installed]
    None

 Steps to reproduce
------------------------------

1. Create cluster with HA without Ceph(default) + Nova network
2. Deploy 3 controllers and 1 compute node
3. Delete own VIP node with web UI after successful deploy
4. Press "Deploy Changes" button
5. Add a new controller node(not deleted one)
6. Press "Deploy Changes" button again.

 Expected result
--------------------------

Deploy successful

 Actual result
---------------------

You will see some service db_sync timeout message (heat or cinder ). After that you will see below message

(/Stage[main]/Swift::Storage::Container/Swift::Storage::Generic[container]/Service[swift-container-replicator]) Failed to call refresh: Could not restart Service[swift-container-replicator]: Execution of '/sbin/restart swift-container-replicator' returned 1:

Error log on Logs tab:
https://gist.github.com/anonymous/fcf82ae27af5eaa43dba

  Workaround
----------------------

Press "Deploy Changes" again seems will fix it.

Revision history for this message
Nastya Urlapova (aurlapova) wrote :

Chang-Yi thanks for issue, could you please add diagnostic snapshot?

Changed in fuel:
status: New → Incomplete
Revision history for this message
Chang-Yi Lee (cy-lee) wrote :

node-89 ~ node-92 are controller node

In our reproduce step, delete node-89 first.
After that delete node-92
You can download log file from below link:

https://yadi.sk/d/cStEJ5gpcDwcS

Thanks

Revision history for this message
Chang-Yi Lee (cy-lee) wrote :

sorry, it should be 'add' node-92

Revision history for this message
Chang-Yi Lee (cy-lee) wrote :

Remove node-6, Add node-11

Changed in fuel:
assignee: nobody → Fuel Library Team (fuel-library)
milestone: none → 6.0
status: Incomplete → New
Changed in fuel:
status: New → Triaged
importance: Undecided → Medium
Changed in fuel:
importance: Medium → High
status: Triaged → Confirmed
assignee: Fuel Library Team (fuel-library) → Stanislaw Bogatkin (sbogatkin)
Changed in fuel:
milestone: 6.0 → 5.1.1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/5.1)

Fix proposed to branch: stable/5.1
Review: https://review.openstack.org/137428

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/5.1)

Reviewed: https://review.openstack.org/137428
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=48b969b0c33aa73f11fff4807a7d83e54f7b5aeb
Submitter: Jenkins
Branch: stable/5.1

commit 48b969b0c33aa73f11fff4807a7d83e54f7b5aeb
Author: Vladimir Kuklin <email address hidden>
Date: Tue Oct 14 15:05:24 2014 +0400

    Do not kill swift replicator services

    To move from exec to SysV provider of the service
    in previous releases we had to kill swift replicator
    service with swift-init kill command.

    This is not what we need in 6.0 release as we
    are already managing everything with default OS
    providers. Moreover, this commit is error-prone
    for Ubuntu with upstart provider.

    Change-Id: I9ed3a030b4987f919a9f9ec2d9351f0b2c3623b0
    Closes-bug: #1384089

Changed in fuel:
milestone: 5.1.1 → 6.0
status: Confirmed → Fix Committed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.