| 2015-05-15 12:03:26 |
Alexei Sheplyakov |
bug |
|
|
added bug |
| 2015-05-15 13:03:26 |
Alexei Sheplyakov |
description |
fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|----------|----------------------------|---------|------------|-------------------|-------|---------------|--------|---------
13 | discover | compute (bay-15) (c2:d4) | 7 | 10.20.0.5 | 38:ea:a7:35:c2:d4 | | compute | True | 7
14 | discover | compute (bay-14) (a0:84) | 7 | 10.20.0.4 | 38:ea:a7:90:a0:84 | | compute | True | 7
15 | discover | controller (bay-3) (c0:80) | 7 | 10.20.0.9 | 38:ea:a7:35:c0:80 | | controller | True | 7
16 | discover | ceph (bay-6) (c2:4c) | 7 | 10.20.0.6 | 38:ea:a7:35:c2:4c | | ceph-osd | True | 7
17 | discover | controller (bay-5) (32:b4) | 7 | 10.20.0.12 | 38:ea:a7:11:32:b4 | | controller | True | 7
18 | discover | mongo (bay-11) (c3:78) | 7 | 10.20.0.7 | 38:ea:a7:35:c3:78 | | mongo | True | 7
19 | discover | controller (bay-4) (bf:d0) | 7 | 10.20.0.3 | 38:ea:a7:35:bf:d0 | | controller | True | 7
20 | discover | ceph (bay-8) (2d:84) | 7 | 10.20.0.12 | a6:54:1a:94:86:42 | | ceph-osd | False | 7
21 | discover | zabbix (bay-16) (c3:e0) | 7 | 10.20.0.8 | 38:ea:a7:35:c3:e0 | | zabbix-server | True | 7
22 | discover | ceph (bay-7) (2a:ac) | 7 | 10.20.0.11 | 38:ea:a7:11:2a:ac | | ceph-osd | True | 7
23 | discover | mongo (bay-12) (2a:3c) | 7 | 10.20.0.14 | 38:ea:a7:11:2a:3c | | mongo | True | 7
24 | discover | mongo (bay-13) (32:50) | 7 | 10.20.0.13 | 38:ea:a7:11:32:50 | | mongo | True | 7
(http://paste.openstack.org/show/189347)
Note that the IP of the node 17 and 20 are the same. However DHCP server (dnsmasq) correctly assigns
IP addresses so they are unique (see https://bugs.launchpad.net/fuel/+bug/1418921).
Steps to reproduce:
1. Make sure the dhcp-sequential-ip option is switched off in dnsmasq.conf
2. Boot ~ 20 -- 40 nodes (VMs are OK too) simultaneously, wait until they get discovered.
3. Ask nailgun about known nodes: run
fuel nodes
on the master node
4. Compare the listed IP addresses with the real ones (ip neigh show or look into dnsmasq leases file)
Preliminary analysis:
dnsmasq can DHCPOFFER the same address to different clients. This behavior is explicitly permitted by RFC 2131 [1].
It's not a problem since the address is not assigned to the client until the server has ACK'ed it.
Sometimes nailgun agent reports the IP from DHCPOFFER even if that IP gets NACKed by the server
(and the DHCP client running on the node in question correctly obtains a new IP). |
fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|----------|----------------------------|---------|------------|-------------------|-------|---------------|--------|---------
13 | discover | compute (bay-15) (c2:d4) | 7 | 10.20.0.5 | 38:ea:a7:35:c2:d4 | | compute | True | 7
14 | discover | compute (bay-14) (a0:84) | 7 | 10.20.0.4 | 38:ea:a7:90:a0:84 | | compute | True | 7
15 | discover | controller (bay-3) (c0:80) | 7 | 10.20.0.9 | 38:ea:a7:35:c0:80 | | controller | True | 7
16 | discover | ceph (bay-6) (c2:4c) | 7 | 10.20.0.6 | 38:ea:a7:35:c2:4c | | ceph-osd | True | 7
17 | discover | controller (bay-5) (32:b4) | 7 | 10.20.0.12 | 38:ea:a7:11:32:b4 | | controller | True | 7
18 | discover | mongo (bay-11) (c3:78) | 7 | 10.20.0.7 | 38:ea:a7:35:c3:78 | | mongo | True | 7
19 | discover | controller (bay-4) (bf:d0) | 7 | 10.20.0.3 | 38:ea:a7:35:bf:d0 | | controller | True | 7
20 | discover | ceph (bay-8) (2d:84) | 7 | 10.20.0.12 | a6:54:1a:94:86:42 | | ceph-osd | False | 7
21 | discover | zabbix (bay-16) (c3:e0) | 7 | 10.20.0.8 | 38:ea:a7:35:c3:e0 | | zabbix-server | True | 7
22 | discover | ceph (bay-7) (2a:ac) | 7 | 10.20.0.11 | 38:ea:a7:11:2a:ac | | ceph-osd | True | 7
23 | discover | mongo (bay-12) (2a:3c) | 7 | 10.20.0.14 | 38:ea:a7:11:2a:3c | | mongo | True | 7
24 | discover | mongo (bay-13) (32:50) | 7 | 10.20.0.13 | 38:ea:a7:11:32:50 | | mongo | True | 7
(http://paste.openstack.org/show/189347)
Note that the IP of the node 17 and 20 are the same. However DHCP server (dnsmasq) correctly assigns
IP addresses so they are unique:
[root@f075ca226654 ~]# cat /var/lib/dnsmasq/dnsmasq.leases
1425578387 38:ea:a7:11:2a:3c 10.20.0.14 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:50
1425578382 38:ea:a7:11:32:50 10.20.0.13 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:34
1425578377 38:ea:a7:11:32:b4 10.20.0.12 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:41
1425578375 38:ea:a7:11:2a:ac 10.20.0.11 * *
1425578371 38:ea:a7:35:c0:80 10.20.0.9 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:37
1425578369 38:ea:a7:35:c3:e0 10.20.0.8 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:4d
1425578367 38:ea:a7:35:c3:78 10.20.0.7 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:50
1425578371 38:ea:a7:35:c2:4c 10.20.0.6 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:43
1425578369 38:ea:a7:35:c2:d4 10.20.0.5 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:35
1425578370 38:ea:a7:90:a0:84 10.20.0.4 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:33
1425578368 38:ea:a7:35:bf:d0 10.20.0.3 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:46
(http://paste.openstack.org/show/189328)
Steps to reproduce:
1. Make sure the dhcp-sequential-ip option is switched off in dnsmasq.conf
2. Boot ~ 20 -- 40 nodes (VMs are OK too) simultaneously, wait until they get discovered.
3. Ask nailgun about known nodes: run
fuel nodes
on the master node
4. Compare the listed IP addresses with the real ones (ip neigh show or look into dnsmasq leases file)
Preliminary analysis:
dnsmasq can DHCPOFFER the same address to different clients. This behavior is explicitly permitted by RFC 2131 [1].
It's not a problem since the address is not assigned to the client until the server has ACK'ed it.
Sometimes nailgun agent reports the IP from DHCPOFFER even if that IP gets NACKed by the server
(and the DHCP client running on the node in question correctly obtains a new IP). |
|
| 2015-05-15 15:24:01 |
Dmitry Pyzhov |
tags |
|
module-nailgun-agent |
|
| 2015-05-15 15:24:17 |
Dmitry Pyzhov |
fuel: assignee |
|
Fuel Python Team (fuel-python) |
|
| 2015-05-15 15:24:19 |
Dmitry Pyzhov |
fuel: status |
New |
Confirmed |
|
| 2015-05-16 06:57:32 |
Alexei Sheplyakov |
description |
fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|----------|----------------------------|---------|------------|-------------------|-------|---------------|--------|---------
13 | discover | compute (bay-15) (c2:d4) | 7 | 10.20.0.5 | 38:ea:a7:35:c2:d4 | | compute | True | 7
14 | discover | compute (bay-14) (a0:84) | 7 | 10.20.0.4 | 38:ea:a7:90:a0:84 | | compute | True | 7
15 | discover | controller (bay-3) (c0:80) | 7 | 10.20.0.9 | 38:ea:a7:35:c0:80 | | controller | True | 7
16 | discover | ceph (bay-6) (c2:4c) | 7 | 10.20.0.6 | 38:ea:a7:35:c2:4c | | ceph-osd | True | 7
17 | discover | controller (bay-5) (32:b4) | 7 | 10.20.0.12 | 38:ea:a7:11:32:b4 | | controller | True | 7
18 | discover | mongo (bay-11) (c3:78) | 7 | 10.20.0.7 | 38:ea:a7:35:c3:78 | | mongo | True | 7
19 | discover | controller (bay-4) (bf:d0) | 7 | 10.20.0.3 | 38:ea:a7:35:bf:d0 | | controller | True | 7
20 | discover | ceph (bay-8) (2d:84) | 7 | 10.20.0.12 | a6:54:1a:94:86:42 | | ceph-osd | False | 7
21 | discover | zabbix (bay-16) (c3:e0) | 7 | 10.20.0.8 | 38:ea:a7:35:c3:e0 | | zabbix-server | True | 7
22 | discover | ceph (bay-7) (2a:ac) | 7 | 10.20.0.11 | 38:ea:a7:11:2a:ac | | ceph-osd | True | 7
23 | discover | mongo (bay-12) (2a:3c) | 7 | 10.20.0.14 | 38:ea:a7:11:2a:3c | | mongo | True | 7
24 | discover | mongo (bay-13) (32:50) | 7 | 10.20.0.13 | 38:ea:a7:11:32:50 | | mongo | True | 7
(http://paste.openstack.org/show/189347)
Note that the IP of the node 17 and 20 are the same. However DHCP server (dnsmasq) correctly assigns
IP addresses so they are unique:
[root@f075ca226654 ~]# cat /var/lib/dnsmasq/dnsmasq.leases
1425578387 38:ea:a7:11:2a:3c 10.20.0.14 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:50
1425578382 38:ea:a7:11:32:50 10.20.0.13 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:34
1425578377 38:ea:a7:11:32:b4 10.20.0.12 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:41
1425578375 38:ea:a7:11:2a:ac 10.20.0.11 * *
1425578371 38:ea:a7:35:c0:80 10.20.0.9 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:37
1425578369 38:ea:a7:35:c3:e0 10.20.0.8 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:4d
1425578367 38:ea:a7:35:c3:78 10.20.0.7 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:50
1425578371 38:ea:a7:35:c2:4c 10.20.0.6 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:43
1425578369 38:ea:a7:35:c2:d4 10.20.0.5 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:35
1425578370 38:ea:a7:90:a0:84 10.20.0.4 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:33
1425578368 38:ea:a7:35:bf:d0 10.20.0.3 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:46
(http://paste.openstack.org/show/189328)
Steps to reproduce:
1. Make sure the dhcp-sequential-ip option is switched off in dnsmasq.conf
2. Boot ~ 20 -- 40 nodes (VMs are OK too) simultaneously, wait until they get discovered.
3. Ask nailgun about known nodes: run
fuel nodes
on the master node
4. Compare the listed IP addresses with the real ones (ip neigh show or look into dnsmasq leases file)
Preliminary analysis:
dnsmasq can DHCPOFFER the same address to different clients. This behavior is explicitly permitted by RFC 2131 [1].
It's not a problem since the address is not assigned to the client until the server has ACK'ed it.
Sometimes nailgun agent reports the IP from DHCPOFFER even if that IP gets NACKed by the server
(and the DHCP client running on the node in question correctly obtains a new IP). |
fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|----------|----------------------------|---------|------------|-------------------|-------|---------------|--------|---------
13 | discover | compute (bay-15) (c2:d4) | 7 | 10.20.0.5 | 38:ea:a7:35:c2:d4 | | compute | True | 7
14 | discover | compute (bay-14) (a0:84) | 7 | 10.20.0.4 | 38:ea:a7:90:a0:84 | | compute | True | 7
15 | discover | controller (bay-3) (c0:80) | 7 | 10.20.0.9 | 38:ea:a7:35:c0:80 | | controller | True | 7
16 | discover | ceph (bay-6) (c2:4c) | 7 | 10.20.0.6 | 38:ea:a7:35:c2:4c | | ceph-osd | True | 7
17 | discover | controller (bay-5) (32:b4) | 7 | 10.20.0.12 | 38:ea:a7:11:32:b4 | | controller | True | 7
18 | discover | mongo (bay-11) (c3:78) | 7 | 10.20.0.7 | 38:ea:a7:35:c3:78 | | mongo | True | 7
19 | discover | controller (bay-4) (bf:d0) | 7 | 10.20.0.3 | 38:ea:a7:35:bf:d0 | | controller | True | 7
20 | discover | ceph (bay-8) (2d:84) | 7 | 10.20.0.12 | a6:54:1a:94:86:42 | | ceph-osd | False | 7
21 | discover | zabbix (bay-16) (c3:e0) | 7 | 10.20.0.8 | 38:ea:a7:35:c3:e0 | | zabbix-server | True | 7
22 | discover | ceph (bay-7) (2a:ac) | 7 | 10.20.0.11 | 38:ea:a7:11:2a:ac | | ceph-osd | True | 7
23 | discover | mongo (bay-12) (2a:3c) | 7 | 10.20.0.14 | 38:ea:a7:11:2a:3c | | mongo | True | 7
24 | discover | mongo (bay-13) (32:50) | 7 | 10.20.0.13 | 38:ea:a7:11:32:50 | | mongo | True | 7
(http://paste.openstack.org/show/189347)
Note that the IP of the node 17 and 20 are the same.
However DHCP server (dnsmasq) correctly assigns IP addresses so they are unique:
[root@f075ca226654 ~]# cat /var/lib/dnsmasq/dnsmasq.leases
1425578387 38:ea:a7:11:2a:3c 10.20.0.14 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:50
1425578382 38:ea:a7:11:32:50 10.20.0.13 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:34
1425578377 38:ea:a7:11:32:b4 10.20.0.12 * 00:37:33:35:31:35:31:36:43:55:34:34:39:34:35:42:41
1425578375 38:ea:a7:11:2a:ac 10.20.0.11 * *
1425578371 38:ea:a7:35:c0:80 10.20.0.9 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:37
1425578369 38:ea:a7:35:c3:e0 10.20.0.8 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:4d
1425578367 38:ea:a7:35:c3:78 10.20.0.7 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:50
1425578371 38:ea:a7:35:c2:4c 10.20.0.6 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:43
1425578369 38:ea:a7:35:c2:d4 10.20.0.5 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:35
1425578370 38:ea:a7:90:a0:84 10.20.0.4 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:33
1425578368 38:ea:a7:35:bf:d0 10.20.0.3 * 00:37:33:35:31:35:31:36:43:55:34:32:37:46:46:33:46
(http://paste.openstack.org/show/189328)
Steps to reproduce:
1. Make sure the dhcp-sequential-ip option is switched off in dnsmasq.conf
2. Boot ~ 20 -- 40 nodes (VMs are OK too) simultaneously, wait until they get discovered.
3. Ask nailgun about known nodes: run
fuel nodes
on the master node
4. Compare the listed IP addresses with the real ones (ip neigh show or look into dnsmasq leases file)
Preliminary analysis:
dnsmasq can DHCPOFFER the same address to different clients. This behavior is explicitly permitted by RFC 2131 [1].
It's not a problem since the address is not assigned to the client until the server has ACK'ed it.
Sometimes nailgun agent reports the IP from DHCPOFFER even if that IP gets NACKed by the server
(and the DHCP client running on the node in question correctly obtains a new IP). |
|
| 2015-08-05 18:20:07 |
Vladimir Sharshov |
nominated for series |
|
fuel/8.0 |
|
| 2015-08-05 18:20:07 |
Vladimir Sharshov |
bug task added |
|
fuel/8.0 |
|
| 2015-08-05 18:20:12 |
Vladimir Sharshov |
fuel/8.0: status |
New |
Confirmed |
|
| 2015-08-05 18:20:14 |
Vladimir Sharshov |
fuel/8.0: importance |
Undecided |
Medium |
|
| 2015-08-05 18:20:19 |
Vladimir Sharshov |
fuel/8.0: assignee |
|
Fuel Python Team (fuel-python) |
|
| 2015-08-05 18:20:21 |
Vladimir Sharshov |
fuel/8.0: milestone |
|
8.0 |
|
| 2015-08-05 18:20:25 |
Vladimir Sharshov |
fuel: status |
Confirmed |
Won't Fix |
|
| 2015-09-28 15:16:53 |
Dmitry Pyzhov |
bug task deleted |
fuel/8.0.x |
|
|
| 2015-09-28 15:16:59 |
Dmitry Pyzhov |
fuel: status |
Won't Fix |
Confirmed |
|
| 2015-09-28 15:17:03 |
Dmitry Pyzhov |
fuel: milestone |
7.0 |
8.0 |
|
| 2015-09-28 15:25:54 |
Dmitry Pyzhov |
tags |
module-nailgun-agent |
feature module-nailgun-agent |
|
| 2015-10-06 13:44:01 |
Alexey Shtokolov |
fuel: status |
Confirmed |
Triaged |
|
| 2015-10-06 13:44:47 |
Alexey Shtokolov |
fuel: importance |
Medium |
Low |
|
| 2015-10-22 03:06:28 |
Dmitry Pyzhov |
tags |
feature module-nailgun-agent |
area-python feature module-nailgun-agent |
|
| 2016-01-15 15:34:57 |
Alexander Kislitsky |
fuel: milestone |
8.0 |
9.0 |
|
| 2016-04-10 21:36:45 |
Fuel Devops McRobotson |
fuel/mitaka: importance |
Undecided |
Low |
|
| 2016-04-10 21:36:45 |
Fuel Devops McRobotson |
fuel/mitaka: status |
New |
Triaged |
|
| 2016-04-10 21:36:45 |
Fuel Devops McRobotson |
fuel/mitaka: milestone |
|
9.0 |
|
| 2016-04-10 21:36:45 |
Fuel Devops McRobotson |
fuel/mitaka: assignee |
|
Fuel Python Team (fuel-python) |
|
| 2016-04-10 21:36:47 |
Fuel Devops McRobotson |
fuel/newton: milestone |
9.0 |
10.0 |
|
| 2016-04-10 21:36:50 |
Fuel Devops McRobotson |
fuel/mitaka: status |
Triaged |
Won't Fix |
|
| 2016-06-22 14:37:18 |
Dmitry Pyzhov |
fuel/newton: assignee |
Fuel Python (Deprecated) (fuel-python) |
Fuel Sustaining (fuel-sustaining-team) |
|
