Mongodb is not deployed in HA mode

Bug #1424919 reported by Denis Ipatov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Bartłomiej Piotrowski
6.0.x
Fix Committed
High
Bartłomiej Piotrowski

Bug Description

MongoDB cluster is not created during deploy.

The parameter /proc/sys/net/ipv4/tcp_keepalive_time is too small for deploy mongodb. MongoDB guide recommends to use the following value:
echo 300 > /proc/sys/net/ipv4/tcp_keepalive_time

Denis Ipatov (dipatov)
summary: - Mongodb is not deployed
+ Mongodb is not deployed in HA mode
tags: added: customer-found
description: updated
description: updated
Changed in fuel:
status: New → Confirmed
importance: Undecided → Medium
status: Confirmed → New
assignee: nobody → Bartlomiej Piotrowski (bpiotrowski)
milestone: none → 6.1
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/159400

Changed in fuel:
status: New → In Progress
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

If a mongo role was shared with a controller role, the suggested fix would interfere with existing failover scenarios which rely on a 30 seconds value for TCP KA. So, this fix requires additional verification against any potential regressions.

Changed in fuel:
importance: Medium → High
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

Related bugs which should be verified for regressions are https://bugs.launchpad.net/fuel/+bug/1322259 and https://bugs.launchpad.net/fuel/+bug/1289200

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/159400
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=1619deaf1133746f5205b3ae3136adadbb51b04e
Submitter: Jenkins
Branch: master

commit 1619deaf1133746f5205b3ae3136adadbb51b04e
Author: Bartłomiej Piotrowski <email address hidden>
Date: Thu Feb 26 11:31:21 2015 +0100

    Set tcp_keepalive_time to 300 on MongoDB nodes

    The default value of 30 seconds may cause socket errors between members
    of a cluster. Setting it to 300 is recommended in the official
    documentation[1].

    Exclude controllers not to overwrite the fix for
    Ic9d491f4904a5e665278027fc37254003c4b5172.

    [1] http://docs.mongodb.org/manual/faq/diagnostics/

    Change-Id: If79702fbf51da8b68fde8a7f50f286656335cd5c
    Closes-Bug: 1424919

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/6.0)

Fix proposed to branch: stable/6.0
Review: https://review.openstack.org/160675

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: stable/6.0
Review: https://review.openstack.org/161158

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (stable/6.0)

Change abandoned by Bart?omiej Piotrowski (<email address hidden>) on branch: stable/6.0
Review: https://review.openstack.org/160675
Reason: https://review.openstack.org/#/c/161158/

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/6.0)

Reviewed: https://review.openstack.org/161158
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=cf24d0efefa4f2c92e48570dadb81801b40f98f8
Submitter: Jenkins
Branch: stable/6.0

commit cf24d0efefa4f2c92e48570dadb81801b40f98f8
Author: Bartłomiej Piotrowski <email address hidden>
Date: Tue Mar 3 08:30:44 2015 +0100

    Set tcp_keepalive_time to 300 on MongoDB nodes

    The default value of 30 seconds may cause socket errors between members
    of a cluster. Setting it to 300 is recommended in the official
    documentation[1].

    Exclude controllers not to overwrite the fix for
    Ic9d491f4904a5e665278027fc37254003c4b5172.

    [1] http://docs.mongodb.org/manual/faq/diagnostics/

    (Adapted from 1619deaf1133746f5205b3ae3136adadbb51b04e)

    Closes-Bug: 1424919
    Change-Id: If79702fbf51da8b68fde8a7f50f286656335cd5c

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-library (stable/6.0)

Related fix proposed to branch: stable/6.0
Review: https://review.openstack.org/163414

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-library (stable/6.0)

Reviewed: https://review.openstack.org/163414
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=59337f43cbc69cf0107b50987587672da665b71b
Submitter: Jenkins
Branch: stable/6.0

commit 59337f43cbc69cf0107b50987587672da665b71b
Author: Bartłomiej Piotrowski <email address hidden>
Date: Wed Mar 11 14:02:02 2015 +0100

    Ensure net.ipv4.tcp_keepalive_time hasn't been duplicated

    Change-Id: I78c5000be53c597120d5703a93198b059147701f
    Closes-Bug: 1430449
    Related-Bug: 1424919

Revision history for this message
Anastasia Palkina (apalkina) wrote :

Verified on ISO #226

"build_id": "2015-03-24_22-54-44", "ostf_sha": "a4cf5f218c6aea98105b10c97a4aed8115c15867", "build_number": "226", "release_versions": {"2014.2-6.1": {"VERSION": {"build_id": "2015-03-24_22-54-44", "ostf_sha": "a4cf5f218c6aea98105b10c97a4aed8115c15867", "build_number": "226", "api": "1.0", "nailgun_sha": "3b9f2c83c63653113701971492a6d8039db2cce2", "production": "docker", "python-fuelclient_sha": "3624051242c83fdbdd1df9a0e466797c06b75043", "astute_sha": "631f96d5a09cc48bfbddcbf056b946c8a80438f0", "feature_groups": ["mirantis"], "release": "6.1", "fuelmain_sha": "320b5f46fc1b2798f9e86ed7df51d3bda1686c10", "fuellib_sha": "acd7659a727ab890076de41272c2054744be4d20"}}}, "auth_required": true, "api": "1.0", "nailgun_sha": "3b9f2c83c63653113701971492a6d8039db2cce2", "production": "docker", "python-fuelclient_sha": "3624051242c83fdbdd1df9a0e466797c06b75043", "astute_sha": "631f96d5a09cc48bfbddcbf056b946c8a80438f0", "feature_groups": ["mirantis"], "release": "6.1", "fuelmain_sha": "320b5f46fc1b2798f9e86ed7df51d3bda1686c10", "fuellib_sha": "acd7659a727ab890076de41272c2054744be4d20"

For 3 controller+mongo nodes
 [root@node-1 ~]# cat /proc/sys/net/ipv4/tcp_keepalive_time
30
[root@node-2 ~]# cat /proc/sys/net/ipv4/tcp_keepalive_time
30
[root@node-3 ~]# cat /proc/sys/net/ipv4/tcp_keepalive_time
30

For standalone mongo node
[root@node-9 ~]# cat /proc/sys/net/ipv4/tcp_keepalive_time
300

Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.