Duplicate IPs during deploy on 90 nodes env

Looks like https://bugs.launchpad.net/fuel/+bug/1376680 has the same root

Increase PXE network to /16 do not helps.

eth0 Link encap:Ethernet HWaddr 52:54:00:C1:D8:EE
          inet addr:10.20.0.2 Bcast:10.20.255.255 Mask:255.255.0.0
          inet6 addr: fe80::5054:ff:fec1:d8ee/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
          RX packets:56963168 errors:0 dropped:0 overruns:0 frame:0
          TX packets:45493126 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:5669525789 (5.2 GiB) TX bytes:76746845514 (71.4 GiB)

[root@fuel ~]# fuel nodes | grep 10.20.1.188
93 | error | compute_23 | 1 | 10.20.1.188 | 0c:c4:7a:1d:92:7a | cinder, compute | | False
29 | discover | Untitled (92:ae) | None | 10.20.1.188 | 0c:c4:7a:1d:92:ae | | | True

[root@fuel ~]# fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online
---|-------------|------------------|---------|-------------|-------------------|-------------------|---------------|-------
20 | provisioned | compute_13 | 1 | 10.20.0.14 | 0c:c4:7a:1d:92:ba | cinder, compute | | True
82 | error | compute_28 | 1 | 10.20.0.46 | 0c:c4:7a:1d:f3:5e | cinder, compute | | True
25 | provisioned | compute_29 | 1 | 10.20.0.17 | 0c:c4:7a:1d:92:68 | cinder, compute | | True
26 | provisioned | compute_12 | 1 | 10.20.0.18 | 0c:c4:7a:1d:92:a8 | cinder, compute | | True
27 | provisioned | compute_22 | 1 | 10.20.0.19 | 0c:c4:7a:1d:91:64 | cinder, compute | | True
93 | error | compute_23 | 1 | 10.20.1.188 | 0c:c4:7a:1d:92:7a | cinder, compute | | False
11 | provisioned | compute_20 | 1 | 10.20.0.7 | 00:25:90:eb:de:90 | cinder, compute | | True
39 | provisioned | compute_21 | 1 | 10.20.0.27 | 0c:c4:7a:1d:92:c8 | cinder, compute | | True
17 | provisioned | compute_26 | 1 | 10.20.0.11 | 0c:c4:7a:1d:92:9a | cinder, compute | | True
66 | error | compute_27 | 1 | 10.20.0.38 | 0c:c4:7a:1d:92:a4 | cinder, compute | | True
89 | error | compute_24 | 1 | 10.20.1.81 | 0c:c4:7a:1d:f1:d4 | cinder, compute | | False
33 | provisioned | compute_25 | 1 | 10.20.0.23 | 0c:c4:7a:1d:92:d6 | cinder, compute | | True
57 | provisioned | compute_9 | 1 | 10.20.0.35 | 0c:c4:7a:1d:f6:42 | cinder, compute | | True
31 | provisioned | compute_8 | 1 | 10.20.0.21 | 0c:c4:7a:1d:94:00 | cinder, compute | | True
34 | provisioned | compute_3 | 1 | 10.20.0.24 | 0c:c4:7a:1d:91:4c | cinder, compute | | True
12 | provisioned | compute_2 | 1 | 10.20.0.8 | 00:25:90:eb:d8:06 | cinder, compute | | True
10 | provisioned | compute_1 | 1 | 10.20.0.6 | 0c:c4:7a:1d:95:7a | ci...

Hi, is it possible to get access to live environment with this problem?
Or atleast can you provide next information:
1. dnsmasq leases
2. all cobbler profiles

Problem is on the side of nailgun. Somehow nailgun sends several nodes with same ipaddress.
Are you using build with custom patches or this is what we have in master?

Nailgun commit is head in stable/5.1.

Related fix proposed to branch: master
Review: https://review.openstack.org/127946

It looks like this MAC addresses give conflicts:
0c:c4:7a:1d:91:64
0c:c4:7a:1d:93:da
0c:c4:7a:1d:90:fe
0c:c4:7a:1d:92:76

Reviewed: https://review.openstack.org/127946
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=de060cc37f232870bf1f699b3973fc425e9abe05
Submitter: Jenkins
Branch: master

commit de060cc37f232870bf1f699b3973fc425e9abe05
Author: Łukasz Oleś <email address hidden>
Date: Sun Oct 12 22:05:54 2014 +0200

    Add dhcp-sequential-ip option to dnsmasq

    For many simultaneously DHCPDISCOVER requests dnsmasq
    can offer the same IP for two different MAC addresses.
    This option prevents it by assigning IPs one by one
    instead of using hashing algorithm.

    Change-Id: Iff3c42d21e1f1c09cb9eab5f07dbb066508dcb56
    Related-bug: 1378000
    Related-bug: 1376680
    Related-bug: 1379917
    Blueprint: 100-nodes-support

Related fix proposed to branch: stable/5.1
Review: https://review.openstack.org/128611

Reviewed: https://review.openstack.org/128611
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=1a785608f7b45af20a165b7cae1a5e2f0a4d63e0
Submitter: Jenkins
Branch: stable/5.1

commit 1a785608f7b45af20a165b7cae1a5e2f0a4d63e0
Author: Łukasz Oleś <email address hidden>
Date: Sun Oct 12 22:05:54 2014 +0200

    Add dhcp-sequential-ip option to dnsmasq

    For many simultaneously DHCPDISCOVER requests dnsmasq
    can offer the same IP for two different MAC addresses.
    This option prevents it by assigning IPs one by one
    instead of using hashing algorithm.

    Change-Id: Iff3c42d21e1f1c09cb9eab5f07dbb066508dcb56
    Related-bug: 1378000
    Related-bug: 1376680
    Related-bug: 1379917
    Blueprint: 100-nodes-support

Still getting duplicated IPs for a couple of nodes. Fuel 9.0 (9.1)

[root@fuel ~]# grep 10.21.8.171 fresh.node.list
| 1078 | Untitled (d1:28) | discover | ubuntu | [] | 10.21.8.171 | 52:54:00:6c:d1:28 | None | Standard PC (i440FX + PIIX, 1996) | False |
| 39 | Untitled (39:04) | discover | ubuntu | [] | 10.21.8.171 | 52:54:00:2a:39:04 | None | Standard PC (i440FX + PIIX, 1996) | True |
[root@fuel ~]#

dnsmasq.conf contains dhcp-sequential-ip option. Perhaps, it doesn't work with more than 1000 nodes.

There's more than 200Gb of logs, i can't attach all of them. The env is still online, but we need to react ASAP. No idea, how long it would be kept.

Marked as Invalid, created new one instead -> https://bugs.launchpad.net/fuel/+bug/1630299